ADA  03  3 184 


Approved  for  public  releflftf 
distribution  unlimited* 


Fritz  H.  Brecke 


April  1975 


* T 


CUES  AND  PRACTICE  IN  FLYING  TRAINING 


• ..  > c ar 


Department  of  Educational  Technology 


DEC  13  1973 


Arizona  State  University 


Tempe , AZ  85281 


L J i_ 

A ‘ 


Duf 


TECHNICAL  NOTE  NO.  50430 


Grant  No.  AFOSR  71-2128 
Office  of  Scientific  Research 
United  States  Air  Force 


,.  , rV-  n-SEARCH  ( AFSC) 


•d  r.ad 


.TEMPF..  ARIZONA  6?261 


BSSCANCH  er-.-NTS  AND  CONTRACTS 


Alfr*  J R.  Freely*  Ph.D. 

I to gram  Manager 

life  Scierccs  Directorate 

Air  Force  Office  of  Scientific  Research 

Department  of  the  Air  Force 

bo:j,i;:g  air  force  base 

Washington,  D.C.  2033?. 


Technical  Reports — U.S,  Air  Force  Office  of 
Scientific  Rcrcan~ch  Grants  ArOSR-7i-?.12S  and 


AFO3R-76-29C0 


H.  B.  Huimicutt 
Director 

Research  Grants  and  Contracts 


Technical  /^ote.!  No**  50430 


Research  sponsored  by  the  Air  Force  Office  of  Scientific  Research,  Air 
Force  Systems  Command,  USAF,  under  Grant  No..  AFOSR  71-2128. ""the  United 
States  Government  is  authorized  to  reproduce  and  distribute  reprints 
for  Governmental  purposes  notwithstanding  any  copyright  notation  hereon. 


Arizona  State  University 
Tempe,  Arizona 

April,  1975 


jt^yprov0'1  publie  rale***} 

diatrlbi  t ii  unlimited. 


Cues, ^feedback  and  Transfer  in 
Undergraduate-Pilot  Training 
Vernon  S.  Gerlach,  Principal  Investigator 


CUES  AND  PRACTICE  IN  FLYING  TRAINING 


Concents 


Research  Background 


Theoretical  Framework 


Related  Research 


Mental  Practice 


Verbal  Pretraining 


Differential  Instructions 


Variables  and  Hypotheses 


Independent  Variables 


Dependent  Variables 


Hypotheses 


Method 


Subjects 


Apparatus 


Treatment  Materials 


Levels  of  Instructional  Cues 


Currently  Operational  Cues 
Systematically  Developed  Cues 


Levels  of  Practice 


Program  Development  and  Validation 


Design 


Data  Collection  and  Analysis 


Section 


Results  

Cognitive  Performance  

Perceptual  Motor  Performance  

Straight  and  Level  Warm-Up  

Vertical  S Trials  

Correlations  between  Cognitive  Mastery  and 
Perceptual  Motor  Performance  

Questionnaire  

Discussion  ...  

References  

Appendices 


List  of  Tables 


Table 


1 Program  Evaluation  Data,  Tryout  #2 


Correlations  between  Subject  Characteristics  and 
Perceptual  Motor  Performance  Scores  for  the 
Straight  and  Level  Warm-up  Period  


Correlations  between  Subject  Characteristics  and 
Perceptual  Motor  Scores  (Means  over  Trials) 
for  the  Vertical  S Trials  Portion  


5  Group  Means  for  Cognitive  Performance  Measures 


6  Mean  Group  Scores  for  Perceptual  Motor  Performance 
during  Straight  and  Level  Warm-up  


7  Mean  Group  Scores  for  Perceptual  Motor  Performance 
over  Six  Vertical  S Trials  (Error  Amplitude) 


8  Mean  Group  Scores  for  Perceptual  Motor  Performance 
over  Six  Vertical  S Trials  (Hit  Rate)  


Mean  Group  Scores  for  Perceptual  Motor 
Performance  over  Six  Vertical  S Trials 
(Percent  Time  on  Criterion)  


10  Mean  Group  Scores  for  Perceptual  Motor  Performance 
Averaged  over  Trials  (All  Descriptors)  .... 


11  Analysis  of  Variance:  Error  Amplitude  E 


12  Analysis  of  Variance:  Hit  Rate  H 


13  Analysis  of  Variance 


t Tests  for  Groups  A & B (Systematic  Cues)  versus 
Groups  C & D (Current  Cues)  for  Trials  1 and  2 


15  Correlations  between  Cognitive  Mastery  and 

Perceptual  Motor  Performance  on  Six  Trials 


Correlations  between  Cognitive  Mastery  and 
Perceptual  Motor  Performance  during  the 
Warm-up  and  during  the  Trial  Period  . . 


17  Subject  Performance  of  Five  Instructional  Procedures 


18  Mean  Subject  Ratings  of  the  Experimental  Treatments 
Received  during  Cognitive  Pretraining  


List  of  Figures 

Figure 

1 Student  Pilot  Training  Procedure  

2 Closed  Loop  Control  System:  Pilot  - Aircraft  

3 Perceptual  motor  performance  as  measured  by 

error  amplitude  (scores  summed  across 

variables)  for  three  levels  of  cues  over 

six  trials  (A  x D interaction)  

4 Perceptual  motor  performance  as  measured  by  hit 

rate  (scores  summed  across  variables)  for  three 
levels  of  cues  over  six  trials  (A  x D interaction)  . . . 

5 Perceptual  motor  performance  as  measured  by 

percent  time  on  criterion  (scores  summed 
across  variables)  for  three  levels  of  cues 
over  six  trials  (A  x D interaction)  


UTEXT-J  'Iff  II 


vi 


List  of  Appendices 

Appendix  Page 

A Sunmary  and  Raw  Data  on  Subject  Characteristics 75 

B Experimental  Information  for  the 

Participating  Subjects  81 

C Statement  of  Consent 83 

D Layout  of  the  Experimental  Facility  87 

E Structure  of  the  Instructional  Programs 89 

F Sample  Program,  Treatment  A: 

Systematic  Cues,  Low  Practice  92 

6 Levels  of  Instructional  Cues 145 

H Program  Changes  during  Formative  Phase  148 

I Experimentor  - Subject  Communications  150 

J Subject  Master  Sheet  and  Protocol  Sheet  (Examples)  ....  153 

K Questionnaire  156 

L Scoring  Algorithm  and  Keys 160 


■ I 


T . 


■ BBBj U| 


CUES  AND  PRACTICE  IN  FLYING  TRAINING 


Problem  and  Antecedents 


Flight  Instruction  in  military,  commercial  or  civil  aviation  is 
partly  conducted  in  the  air  and  partly  on  the  ground.  It  is  perfectly 
logical  and  immediately  evident  that  the  theoretical  bases  (as  opposed  to 
the  applications)  of  such  subjects  as  meteorology,  aerodynamics  and  navi- 
gation are  more  economically  taught  on  the  ground.  However,  ground-based 
instruction  does  not  stop  with  these  "academic"  components  of  a typical 
flying  course.  Even  that  part  of  flight  instruction  which  deals  directly 
with  the  practical  control  of  an  aircraft  in  flight  (e.g.,  flying  a 
barrel  roll)  is  to  a large  part  conducted  in  classrooms  and  briefing 
rooms  on  the  ground.  General  consensus  among  flight  instructors  has  it 
that  for  each  hour  in  the  air  the  student  pilot  should  spend  at  the  very 
least  an  equal  amount  of  time  preparing  himself  on  the  ground.  The  typi- 
cal sequence  of  instructional  events  for  a sortie  in  the  aircraft  is 
shown  in  Figure  1.  This  instructional  procedure  is  based  on  the  implicit 
and  tacitly  accepted  assumption  that  some  form  and  amount  of  cognitive 
training  must  precede  hands-on  In-flight  training  in  an  aircraft  or  a 
simulator  if  the  sortie  is  to  be  successful  and  productive.  Cognitive 
pretraining,  in  other  words,  is  assumed  to  be  a necessary  although  not  a 
sufficient  condition  for  the  efficient  acquisition  of  the  con$>lex  percep- 
tual-motor skills  which  are  involved  in  flying  an  airplane. 
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Under  current  USA?  regulations,  cognitive  pretraining  Is  admini- 
stered in  the  form  of  oral  briefings  which,  as  Figure  1 shows,  are  pre- 
ceded by  self-study  of  manual  texts  at  the  student's  own  discretion  and 
pace.  At  least  as  far  as  USAF  Undergraduate  Pilot  Training  (UPT)  is  con- 
cerned, neither  the  manuals  nor  most  of  the  briefings  Include  any  overt 
verbal  practice  and  feedback.  The  current  form  of  cognitive  pretraining 
max  therefore — for  all  practical  purposes — be  characterized  as  a rote 
learning  exercise  or  a one-way  information  dissemination  from  the  teach- 
ing system  (manual  plus  instructor)  to  the  student. 

The  subject  matter  of  cognitive  pretraining  consists  essentially  of 
verbal  information  on  how  to  fly  a given  maneuver . This  information  is 
presented  either  in  the  form  of  a procedure  or  in  the  form  of  a technique 
or  both.  The  distinction  between  the  two  is  discussed  in  detail  in 
Reiser,  Brecke,  and  Gerlach  (1972).  A brief  discussion  of  the  most  rele- 
vant characteristics  of  each  is  given  below. 


Procedures  exist  in  many  forms.  From  the  filing  of  a flight  plan 
to  the  walk- around  inspection  and  back  to  taxiing,  parking,  and  filling 


out  the  debriefing  forms,  the  actions  of  a pilot  are  nearly  always  under 


the  dictate  of  one  procedure  or  another.  Procedure  is  an  official  pre- 


scription, quasi-algorithmic  in  character,  which  consists  of  steps  or 


chunks  of  information  which  can  represent  an  elementary  action.  Other 
important  features  include  a generally  sequential  structure,  the  rela- 
tive ease  with  which  an  observer  can  determine  whether  or  not  a given 
procedure  is  being  performed  adequately,  and  its  use  as  a standardiza- 
tion device.  The  procedures  currently  evident  in  the  UPI  curriculum 
generally  deal  with  tasks  of  a relatively  low  level  of  complexity,  i.e., 
with  linear  sequential  tasks  involving  a finite  set  of  discrete  steps. 
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They  may  also  deal  with  the  target  values  of  complex  continuous 
control  tasks,  i.e.,  the  concept  "procedure"  in  the  vernacular  of  the 
flight  line  has  come  to  include  those  written  parts  of  the  subject  matter 
for  a specific  flight  maneuver  which  determine  or  describe  desired  per- 
formance characteristics. 

Information  beyond  performance  characteristics  of  complex  control 
tasks  is  supplied  to  the  learner  in  the  form  of  "technique"  rather  than 
procedure. 

A technique,  in  its  pure  form,  is  essentially  heuristic  while  a 
procedure,  in  its  pure  form,  is  algorithmic.  Heuristics  are  efficient 
strategies  for  the  solution  of  many  kinds  of  complex  control  problems. 

This  is  especially  true  if  the  heuristics  have  been  refined  by  experience, 
i.e.,  by  a more  or  less  lengthy  trial  and  error  process.  However,  tech- 
niques as  they  are  currently  taught  and  generated  in  UPT  present  a prob- 
lem. Transmitted  by  word  of  mouth  from  instructor  pilot  (IP)  to  student 
pilot  (SP) , they  represent  a highly  idiosyncratic  and  jealously  guarded 
body  of  flight  line  folklore.  Each  technique  is  considered  to  be  the 
"personal  property"  of  an  IP  and  consequently  technique  as  subject  matter 
never  really  becomes  part  of  the  public  domain.  This  leads  to  ineffi- 
ciencies in  the  instructional  process  for  a number  of  reasons: 

(1)  Techniques  vary  considerably  in  terms  of  efficiency  and  utility. 

(2)  The  typical  instructor  pilot  has  not  had  enough  experience 


either  as  a pilot  or  as  a teacher  to  develop  sound  and  teachable  techni- 
ques. This  is  especially  true  of  IP's  : ho  become  instructors  immediately 
after  basic  flight  training. 
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(d)  Due  to  the  idiosyncratic,  non-standardlzed  nature  of  technique 
(as  well  as  the  high  instructor  pilot  turnover  rate)  performance  evalu- 
ation at  best  lacks  empirical  reliability. 

(4)  There  may  or  may  not  be  congruence  between  the  technique  an 
instructor  transmits  verbally  and  the  technique  he  actually  employs  in  a 
demonstration.  This  is  a potential  source  of  confusion  for  the  student 
and  may  inhibit  the  effect  of  the  verbal  information  intended  to  facili- 
tate acquisition. 

If  we  assume  that  verbal  cognitive  pretraining  has  facilitating 
effects  on  the  subsequent  acquisition  of  a complex  perceptual -motor  skill, 
and  that  these  effects  are  directly  related  to  qualitative  or  quantita- 
tive characteristics  of  the  verbal  information  which  is  administered, 
then  it  is  reasonable  to  hypothesize  that  that  portion  of  training  which 
consists  of  (private)  technique  could  benefit  from  an  intensive  task- 
analytic  effort  aimed  at  a precise  and  explicit  specification  of  all 
information  relative  to  training  for  a given  task. 

The  effect  of  one  such  parameter,  the  instructional  cue  (IC) , has 
been  discussed  in  a review  by  Roberts  and  Taylor  (1972) . In  its  simpli- 
est  form,  an  IC  is  that  minimal  informational  stimulus  which  a learner 
needs  in  order  to  emit  or  acquire  a previously  unlearned  behavior. 

For  example,  in  order  to  learn  the  skill  of  parking  one's  car  para- 
llel to  and  between  two  other  cars,  a learner  requires  a set  of  at  least 
three  instructional  cues  which  may  take  a verbal  form  or  a pictorial 
form  or  which  may  be  given  by  using  models  or  any  combination.  Whatever 
form  is  used,  the  cues  must  be  successful  in  conveying  the  following: 

(1)  One  has  to  start  the  maneuver  from  a position  parallel  to  and 
alongside  the  first  car. 
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(2)  Back  up  while  steering  the  front  wheels  away  from  the  first 

car. 

(3)  Reverse  the  steering  as  soon  as  the  driver's  seat  is  even  with 
the  rear  of  the  first  car. 

It  is  quite  obvious  that  these  cues  can  be  worded  much  more  suc- 
cintly  and  clearly.  It  is  also  intuitively  clear  that  cues  which  are 
well  formulated  will  be  more  effective  in  helping  a learner  to  acquire 
the  desired  behavior  than  cues  which  are  less  well  formulated.  This  is, 
of  course,  as  true  for  flying  training  as  it  is  for  driver  education. 

J 

An  analysis  of  the  cue  content  of  current  manual  texts  and  oral 
briefings  in  USAF  undergraduate  pilot  training  has  shown  that  the 
instructional  cues  contained  in  these  materials  differ  considerably 
from  instructional  cues  which  were  developed  by  a systematic,  semi- 
algorithmic  procedure  including  a maneuver  analysis  based  on  a closed- 
loop  control  model.  Systematically  developed  cues  were  less  ambiguous 
and  more  specific,  showed  less  variation  in  syntax  and  a more  even 
coverage  of  the  segments  of  a particular  maneuver.  The  research  ques- 
tion that  follows  is,  in  its  simpliest  form,  "Can  the  learning  of  a 
complex  perceptual  motor  skill  be  affected  by  systematically  controlling 
the  quality  and  the  quantity  of  IC's  in  cognitive  pretraining  materials?" 

A pilot  experiment  was  conducted  to  test  the  differential  effective- 
ness of  currently  operational  cues  and  systematically  developed  cues 
against  a group  receiving  the  maneuver  objective  (as  the  two  other 
groups)  but  no  instructional  cues  whatsoever.  Summative  performance 
measures  over  all  relevant  flight  parameters  did  not  show  significant 
differences  between  the  treatment  groups.  Analysis  of  performance  on 
separate  flight  parameters,  however,  revealed  significant  variations 
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between  groups  which  were  directly  attributable  to  specific  instructional 
cues.  These  results  suggest  that  the  treatments  as  administered  were 
sufficiently  powerful  to  produce  learning  of  Isolated  cues  but  not 
powerful  enough  to  produce  mastery  of  whole  sets  of  cues.  One  plausible 
explanation  for  this  effect  lies  in  the  complete  absence  of  overt  cogni- 
tive practice  in  the  treatments.  It  may,  therefore,  be  assumed  that  the 
amount  of  practice  during  pretraining  is  another  important  factor  influ- 
encing transfer  to  perceptual-motor  skills.  Increasing  amounts  of  prac- 
tice should  lead  to  higher  cognitive  mastery  and,  therefore,  to  an 
increased  availability  of  the  cues  during  perceptual-motor  performance. 

The  experiment  described  in  this  report  was  performed  to  investi- 
gate the  effects  of  cognitive  pretraining  with  two  levels  of  Instructional 
cues  and  two  levels  of  practice  on  the  acquisition  of  a complex  percep- 
tual motor  skill,  i.e.,  flying  the  maneuver  Vertical  S-A  in  a flight 
simulator. 


Theoretical  Framework 

Several  researchers  have  suggested  that  learning  a perceptual  motor 
skill  is  a process  which  involves  two  to  three  more  or  less  clearly 
identifiable  stages.  Fitts  and  Posner  (1967)  propose  a three-stage 
model  with  an  early  or  cognitive  phase,  an  intermediate  or  associative 
phase  and  a final  or  autonomous  phase.  Adams  (1971)  assumes  that  the 
acquisition  of  a perceptual  motor  skill  proceeds  in  two  stages  which  he 
calls  the  Verbal-Motor  State  and  Motor  StatQ  respectively.  Posner  and 
Keele  (1973)  present  a two-stage  model  where  the  learner  initially  relies 
on  conscious  control  and  external  feedback  in  closed-loop  fashion  and 
later  shifts  to  "automatic"  open-loop  control  independent  of  external 
feedback. 

The  common  denominator  for  these  three  theoretical  models  is  the 
concept  of  an  initial  stage  of  perceptual  motor  learning  which  is  under 
verbal  cognitive  control  (Adams,  1971,  p.  131).  During  this  phase*  the 
learner  tries  to  "understand"  (Fitts,  1967,  p.  11)  the  task  to  be  per- 
formed and  constructs  his  responses  with  the  aid  of  verbal  cognitive 
antecedents.  Fitts  and  Posner  (1967)  speak  of  the  development  of  an 
"executive  program"  (p.  11)  during  this  phase,  which  "allows  for  the 
selection  of  an  initial  repertoire  of  subroutines  from  the  available  cues 
that  have  been  developed  previously"  (ibid.).  Miller,  Galanter  and 
Pribram  (1966)  are  essentially  in  agreement  with  this  position  when  they 
speak  of  the  "verbalized  strategies  of  a beginner"  (p.  244)  or  of  the 
"verbal  plan"  (ibid.)  that  the  novice  uses  to  guide  his  actions.  During 
this  initial  phase  of  learning,  the  learner  must  rely  on  feedback  which 
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originates  primarily  from  external  sources  and  which  is  processed  in 
verbal  form  (Adams,  1971).  The  learner,  therefore,  operates  initially 
in  closed-loop  control  fashion,  consciously  adjusting  his  actions  on  the 
basis  of  external  feedback  (Posner  and  Keele,  1973). 

A more  concise  formulation  of  the  assumptions  presented  above, 
applied  to  the  specific  case  of  flying  skill  acquisition,  was  given  in 
Brecke  et  al.,  1974: 

"(1)  There  are  certain  identifiable  cognitive  (or  verbal)  behaviors 
which  are  necessary,  although  not  sufficient,  conditions  for  learning  a 
complex  perceptual  motor  skill. 

"(2)  The  student  passes  through  a series  of  successive  approxima- 
tions beginning  with  a cognitive  skill;  gradually  he  adds  a more-or-less 
unrefined  motor  response,  and  he  terminates  the  process  with  the  satis- 
factory integration  of  the  cognitive  behavior  with  a complex  perceptual 
motor  skill. 

"(3)  At  the  same  time,  the  control  of  the  student's  behavior  gradu- 
ally shifts  from  stimuli  extrinsic  to  his  task  in  the  aircraft  or  simula- 
tor (e.g.,  textual  and  oral  instruction)  to  task-intrinsic,  stimuli  (e.g., 
instruments,  motion,  sound,  position  of  the  aircraft  with  respect  to 
selected  referents)." 

Given  these  assumptions  it  is  possible  to  prescribe  the  gross  fea- 
tures of  an  instructional  procedure  for  the  acquisition  of  flying  skills, 
but  it  is  not  possible  to  infer  details  of  form  and  content.  If  the 
initial  phase  of  perceptual  motor  skill  learning  is  indeed  under  verbal 
cognitive  control,  then  initial  instruction  should  be  verbal  cognitive 
as  well,  i.e.,  a cognitive  pretraining  phase  should  precede  hands-on 
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perceptual  motor  skill  training  In  the  aircraft  or  simulator.  Current 
Instruction  in  UPT  is  subdivided  and  sequenced  in  precisely  this  way. 

Specific  desirable  characteristics  of  cognitive  pretraining  in  terms 
of  form  and  content  must  be  derived  from  other  sources.  The  instruc- 
tional materials  currently  used  in  UPT  provide  a useful  starting  point. 
Eight  oral  briefings  on  a specific  maneuver,  as  well  as  the  appropriate 
passages  from  two  manual  texts  (AFM  51-37,  ATCM  51-4)  were  analyzed  by 
four  independent  judges  (see  Brecke  et  al.,  1974).  It  was  found  that 
these  materials  contained  almost  exclusively  verbal  prescriptive  rules 
specifying  what  the  pilot  should  do  and  when  he  should  do  it.  These 
verbal  rules  are  essentially  what  Miller  et  al.  (1966)  have  called  "a 
learner's  crutch”  and  what  has  been  more  rigorously  defined  as  Instruc- 
tional Cues  (Gerlach  et  al.,  1967;  Roberts  et  al.,  1972).  For  any  given 
behavioral  objective  exists  an  instructional  cue  or  a set  of  instruc- 
tional cues,  which  represents  that  information  (in  verbal  or  non-verbal 
form)  which  a learner  needs  in  order  to  acquire  or  emit  the  behavior 
specified  by  the  objective. 

The  assumption  that  cognitive  pretraining  materials  which  consist 
primarily  of  Instructional  cues  should  be  effective  mediating  agents  of 
perceptual  motor  skills  is  both  intuitively  appealing  as  well  as  theore- 
tically defendable.  From  the  viewpoint  of  information  theory,  facilita- 
ting effects  of  cognitively  acquired  cues  may  be  expected  if  the  learner 
can  utilize  them  to  reduce  the  information  processing  load  of  the  percep- 
tual motor  task  (Shannon,  1948;  Weltner,  1969).  This  will  always  be  the 
case  if  (a)  the  cue  is  learned  to  mastery  and  (b)  if  the  instructional 
cue  is  so  designed  that  it  facilitates  the  choice  among  perceptual  cues 
for  the  learner.  An  associationistic  explanation  would  predict 
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facilitation  if  the  instructional  cues  were  of  such  relevance  and  speci- 
ficity  as  to  elicit  fewer  competing  responses  during  the  acquisition 
and/or  performance  of  a skill  (Noble,  Alcock  & Frye). 

The  rather  general  properties  of  instructional  cues  specified  by 
these  theoretical  considerations  are  still  an  Insufficient  basis  for  in- 
structional design.  The  problem  is  at  this  point  (1)  What  are  the 
specific  characteristics  that  instructional  cues  should  have  in  order  to 
be  maximally  facilitative  and  (2)  Is  it  possible  to  develop  an  objective 
procedure  for  the  design  of  maximally  effective  cues? 

Answers  to  these  questions  were  sought  by  employing  control  systems 
theory  to  develop  a model  of  the  pilot’s  Information  processing  task. 

This  approach  to  perceptual  motor  behavior  originated  from  the  writings 
of  Craik  (1948)  and  Wiener  (1948) . These  writers  were  the  first  theore- 
ticians to  apply  the  principle  of  servo  control  from  the  engineering 
sciences  to  human  physiology  and  psychology.  Wiener’s  Cybernetics  in 
particular  presented  a coherent  theoretical  framework  which  was  argued 
with  mathematical  precision  and  which  is  today  a serious  rival  to 
the  various  S-R  approaches.  A number  of  writers  (Welford,  1967;  Adams, 

1971;  Schmidt  & Schmidt,  1966)  in  the  field  have  presented  cogent  argu- 
ments why  the  cybernetic  approach  should  really  replace  any  S-R  theori- 
zing. 

Some  idea  of  the  flexibility  and  power  of  the  servo  control  model 
may  be  conveyed  by  the  range  of  its  applications.  Fairbanks  (1954)  has 
described  the  speech  mechanism  as  a servo  system;  the  Russians  Anokhin 
(1969)  and  Sokolov  (1969)  both  deal  with  phenomena  within  the  central 
nervous  system  and  Frank  (1969)  has  applied  the  model  to  goal  directed 
human  activity  in  general  and  to  the  interaction  of  teacher  and  learner 
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in  particular.  Frank  as  well  as  Paillard  (1960),  Chase  (1965a,  1965b), 
Gibbs  (1970)  and  Adams  (1971)  all  have  dealt  with  perceptual  motor 
activity  and  have  suggested  models  of  varying  complexity.  The  model  de- 
veloped by  Frank  represents  the  most  general  and  parsimonious  work  and 
was,  therefore,  used  (Brecke  et  al.,  1972)  to  develop  a model  of  the  in- 
teractive system  pilot-aircraft  (see  Figure  2).  This  model  is  compatible 
with  the  writings  of  Fitts  (1951,  1954,  1964,  1967)  as  well  as  those  of. 
Posner  and  Keele  (1973) . 

It  is  clear  from  this  model  that  the  pilot  has  to  deal  with  three 
classes  of  information  (Brecke  et  al.,  1972,  pp.  6-8): 

(1)  Information  describing  desired  airplane  performance 

(2)  Information  describing  the  control  activations  which  determine 
airplane  performance 

(3)  Information  describing  current  system  performance. 

It  is  possible  to  compile  these  three  classes  of  information  for  a given 
maneuver  by  using  an  objective  task  analysis  procedure  which  has  been 
called  maneuver  analysis.  The  result  of  a maneuver  analysis  is  a complete 
information  base.  This  information  base  represents  the  content  or  sub- 
ject matter  that  instructional  cues  for  a given  maneuver  must  deal  with. 

An  instructional  designer  and  subject  matter  expert  team  can  then  use 
this  information  base  to  design  instructional  cues  by  asking  a set  of 
standard  questions  (Gerlach  et  al.,  1972).  The  cues  which  have  been 
generated  in  this  maneuver  are  subsequently  checked  against  a list  of 
criteria  (see  Table  1)  which  has  been  developed  on  the  basis  of  the  con- 
trol systems  model  (Brecke  et  al.,  1974). 

To  recapitulate:  the  theoretical  arguments  presented  so  far  result 

in  a set  of  assumptions  concerning  the  design  of  instructional  procedures 
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Table  1 


ram  Evaluation  Data 


Tryout  # 2 


Variables 


Time  through 

Errors  on 

Time  through 

program* 

posttestb 

posttesta 

26.0 

7.5 

10.0 

37.0 

8.5 

7.5 
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and  materials  for  the  teaching  of  perceptual  motor  skills.  These  assump- 
tions are: 

(1)  The  first  stage  of  perceptual  motor  skill  acquisition  Is  under 
verbal  cognitive  control.  Cognitive  pretraining  should,  therefore,  pre- 
cede perceptual  motor  training. 

(2)  Cognitive  pretraining  may  be  described  in  terms  of  the  variable 
Instructional  Cues. 

(3)  The  characteristics  of  Instructional  Cues  which  are  highly 
effective  as  mediators  of  perceptual  motor  skills  can  be  specified  and 
cues  of  this  nature  can  be  developed  on  the  basis  of  an  objective  proce- 
dure based  on  control  systems  theory. 

The  assumptions  (1)  and  (2)  can  be  supported  by  empirical  research 
dealing  with  mental  practice,  verbal  pretraining  and  the  effects  of  dif- 
ferential instructions.  The  third  assumption  is  the  basic  assumption  to 
be  tested  in  this  study.  The  remainder  of  this  section  is  devoted  to* a 
review  of  the  literature  concerning  the  first  two  assumptions  and  to  a 
statement  of  the  specific  hypotheses  which  were  investigated. 


Related  Research 

Mental  Practice.  One  source  of  evidence  to  the  effect  that  cognitive 
factors  may  be  important  determinants  of  perceptual  motor  learning  comes 
from  studies  dealing  with  the  effects  of  mental  practice.  Mental  or  cog- 
nitive practice  or  rehearsal  (the  terms  are  used  interchangeably)  refers 
to  the  practice  of  a physical  activity  without  muscular  movement,  i.e., 
the  learner  imagines  himself  going  through  a perceptual  motor  task  without 
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executing  any  of  the  movements  associated  with  the  task.  Generally, 
studies  of  this  type  have  compared  gain  scores  of  Sis  which  had  been  sub- 
jected to  training  conditions  which  involved  either  mental  practice  or 
physical  practice  or  no  practice. 

Richardson  (1967)  in  a review  of  this  area  of  research,  examined 
25  studies  which  had  been  done  over  the  last  30  years  prior  to  1965. 

He  reports  (p.  102): 

"1.  Despite  a variety  of  methodological  inadequacies  the  trend  of 
most  studies  indicates  that  MP  (mental  practice.  Author.)  procedures 
are  associated  with  improved  performance  on  the  task.  Statistically 
significant  positive  findings  were  obtained  in  11  studies  - () . 

Seven  further  studies  show  a positive  trend  - () . Three  studies  report 
negative  findings  - ()". 

Of  particular  interest  with  regard  to  the  first  assumption  stated 
above  (p.  13),  are  two  conflicting  studies  mentioned  by  Richardson  which 
used  combinations  of  physical  and  mental  practice.  Trussell  (1952) 
found  that  six  days  of  mental  practice  (5  min.  each  day)  followed  by 
14  days  of  physical  practice  resulted  in  the  highest  gain  scores.  The 
second  best  treatment  condition  was  physical  practice  alone;  14  days  of 
mental  practice  (5  min.  daily)  followed  by  6 days  of  physical  practice 
ranked  third  and  the  mental  practice  only  condition  ranked  forth. 

These  results  clearly  support  a cognitive  pretraining  procedure. 

Ammons  (1951)  on  the  other  hand  found  that  a 2-min.  mental  practice 
session  prior  to  a 12-min.  physical  practice  session  did  not  result  in 
significantly  higher  improvements  than  seven  other  combinations.  It 

I 

may  be  argued  that  the  2-min.  mental  practice  interval  was  too  short  to 
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result  in  any  cognitive  learning  and  that  it;  therefore,  may  have  led  to 
interference  rather  than  to  facilitation. 

Relatively  few  mental  practice  studies  have  been  reported  after 
1965.  Shick  (1970)  used  two  tasks,  serving  a volleyball  and  volleying 
against  a wall.  She  found  that  mental  practice  resulted  in  significant 
improvements  over  no  practice  on  the  serving  task  but  not  on  the  volley- 
ing task.  Her  study  did  not  include  a physical  practice  only  condition. 
Hall  (1971)  used  a rotary  pursuit  task  and  found  physical  practice  and 
observational  practice  superior  to  mental  practice.  The  latter  group 
did  not  differ  from  a no  practice  group.  He  found  some  indication  sup- 
porting an  earlier  finding  by  Clark  (1960)  that  success  of  mental  prac- 
tice may  depend  on  the  degree  to  which  Ss  are  familiar  with  the  task. 
Rawlings,  Rawlings,  Chen  and  Yilk  (1972)  in  two  very  carefully  controlled 
studies  also  used  rotary  pursuit  tracking,  a task  which  may  be  considered 
unfamiliar  to  most  Ss.  They  demonstrated  clearly  that  mental  rehearsal 
'facilitates  the  acquisition  of  a rotary  pursuit  tracking  skill  and  pro- 
vided evidence  that  a combination  of  mental  practice  and  physical  prac- 
tice may  be  the  most  efficient  technique  for  learning  a perceptual  motor 
skill. 

The  research  reviewed  so  far  permits  the  general  conclusion  that 
perceptual  motor  learning  may  be  partly  a function  of  cognitive  variables, 
especially  during  the  earlier  stages.  More  specific  conclusions  do  not 
appear  warranted  since  the  confounding  of  such  variables  as  the  nature 
and  complexity  of  the  task,  the  effect  of  experimental  instructions,  the 
amount  of  time  for  each  condition,  and  the  sequencing  of  practice  condi- 
tions do  not  allow  direct  comparisons.  Perhaps  the  most  serious  short- 
coming of  this  research  is  the  fact  that  experimental  control  over  the 
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mental  practice  condition  appears  to  have  been  very  weak.  Extreme  cau- 
tion should,  therefore,  be  exercised  in  generalizing  from  these  findings 
to  flying  training.  Another  reason  for  caution  are  differences  in  the 
perceptual  motor  task.  The  tasks  which  have  been  employed  in  mental 
practice  research  were  either  ballistic  open-loop  tasks  (e.g.,  basketball 
throwing)  and,  therefore,  fundamentally  different  from  the  closed-loop 
flying  task,  or  they  were  closed-loop  tasks  (rotary  pursuit)  which  were 
considerably  less  complex  than  any  flying  task.  Rawlings  et  al.  (1972) 
characterize  the  rotary  pursuit  task  as  one  which  "does  not  have  a parti- 
cularly significant  cognitive  component."  This  characterization  certainly 
does  not  apply  to  any  flying  task  where  a variety  of  numerical  stimuli 
from  the  instrument  panel  require  constant  and  substantial  cognitive  in- 
formation processing.'  It  is,  therefore,  conceivable  that  some  form  of 
mental  practice  may  have  very  strong  facilitating  effects  on  perceptual 
motor  skills  which  have  significant  cognitive  components,  such  as  flying. 
This  conclusion  is  supported  by  a recent  study  (Prather,  1973)  which  used 
a flying  skill  (landing  the  T-37  aircraft).  Prather  achieved  a consider- 
able amount  of  control  over  the  mental  rehearsal  condition  by  using  four 
tape  recordings  with  successively  fewer  verbal  prompts.  Ss  who  had  en- 
gaged in  prompted  mental  practice  received  significantly  higher  ratings 
from  instructors  on  their  landings. 

Verbal  Pretraining 

Studies  more  specifically  aimed  at  the  investigation  of  particular 
variables  which  determine  cognitive  facilitation  of  perceptual  motor 
skill  acquisition  have  investigated  transfer  effects  from  various  forms 
of  verbal  discrimination  pretraining.  The  experimental  tasks  used  in 


this  line  of  research  consist  of  the  presentation  of  discrete  static 
stimulus  configurations  (such  as  a single  light  or  a set  of  lights)  to 
which  S.  has  to  make  a single  ballistic  response  (i.e,,  moving  a lever  or 
a switch) . The  pretraining  treatments  consist  in  learning  pairs  of 
stimulus-response  associations  where  either  the  stimuli  or  the  responses 
or  both  are  replaced  by  various  types  of  relevant  or  irrelevant  (verbal) 
substitutes  as  illustrated  in  Table  2. 

Of  particular  interest  to  the  present  study  is  the  type  of  pretrain- 
ing which  has  been  labelled  Relevant  S-R  pretraining  (McAllister,  1953). 
Ss  subjected  to  this  treatment  condition  learn  to  pair  a relevant  stimu- 
lus with  a relevant  response.  This  means  for  example  that  they  learn  to 
say  "right  two"  (meaning:  Switch  #2  on  the  right)  if  presented  with  the 

verbal  stimulus  substituted  "top  green"  which  stands  for  the  top  green 
light  of  a display  (Baker  & Wylie,  1950).  Stimulus-response  combinations 
of  this  type  are  essentially  atomic  rules  (Scandura,  1968)  or  very  con- 
cise instructional  cues.  These  cues  are  specific*,  they  are  by  definition 
relevant  and--if  learned  to  any  degree — will  certainly  reduce  the  subjec- 
tive information  of  the  perceptual  field  in  the  criterion  task. 

McAllister  administered  five  variations  of  Relevant  S-R  pretraining 
and  compared  these  with  Irrelevant  and  Relevant-S  pretraining.  All  Rele- 
vant S-R  conditions  resulted  in  significantly  fewer  errors  on  the  cri- 
terion task  (Star  discriminator) . Battig  (1956)  used  a finger  position- 
ing apparatus  and  found  Relevant  S-R  pretraining  more  facilitative  than 
Relevant-S  pretraining  and  a control  condition  which  had  no  pretraining 
at  all.  These  findings  are  in  agreement  with  Baker  and  Wylie  (1950), 
Cantor  (1955)  and  Goss  and  Greenfeld  (1958)  who  all  found  significant 
facilitation  of  subsequent  perceptual  motor  performance  for  groups 
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receiving  relevant  S-R  pretraining,  i.e.,  a pretraining  incorporating 
instructional  cues. 

Especially  interesting  is  the  study  by  McAllister  (1953) . The  de- 
gree of  facilitation  accruing  from  the  Relevant  S-R  pretraining  was 
found  to  be  dependent  on  the  type  of  verbal  response  substitute.  The 
more  closely  the  latter  resembled  a description  of  the  movement  to  be 
made,  the  higher  was  the  positive  transfer  to  the  perceptual  motor  task. 
This  evidence  suggests  that  "relevant"  cues  may  differ  greatly  in  their 
facilitating  effects  depending  on  the  information  processing  they  re- 
ceive. The  more  familiar  the  concepts  are  which  are  included  in  the 
cues  the  greater  will  be  any  facilitative  effect. 

A second  significant  finding  arising  out  of  this  body  of  research 
is  the  fact  that  Sd  performance  on  the  criterion  task  is  not  only  a func- 
tion of  the  characteristics  of  instructional  cues  but  also  of  the  degree 
to  which  these  cues  have  been  practiced  and,  thus,  mastered  in  cognitive 
terms.  In  other  words,  not  only  what  S learns,  but  also  how  well  he 
learns  it,  is  important. 

Baker  and  Wylie  (1950) , in  a verbal  Relevant  S-R  pretraining  experi- 
ment using  a discrimination-reaction  task  gave  8 and  24  verbal  practice 
trials  and  found  significant  amounts  of  transfer  after  24  practice 
triaLs  both  in  terms  of  fewer  errors  and  shorter  reaction  times  but  no 
transfer  after  8 practice  trials.  Holton  and  Goss  (1956)  found  the 
amount  of  perceptual  motor  facilitation  to  be  increasing  with  increasing 
number  of  trials  during  pretraining.  Goss  and  Greenfeld  (1958)  pre- 
trained Ss  to  7 different  criteria  of  mastery  and  found  the  amount  of 
transfer  to  be  a direct  function  of  the  master  levels  attained  during 
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The  findings  of  verbal  pretraining  research  which  have  been  pre- 
sented lend  strong  support  to  the  assumption  that  cognitive  pretraining 
materials  should  incorporate  instructioral  cues  and  that  these  cues  must 
be  practiced  to  a minimal  degree  of  mastery.  There  are  ’ven  some  indi- 
cations as  to  the  specific  characteristics  of  maximally  effective  cues. 
These  results  are  judged  to  be  considerably  more  dependable  than  the  re- 
sults of  mental  practice  studies  because  of  the  superior  experimental 
control  which  is  possible  with  this  paradigm. 

Differential  Instructions 

The  concept  of  cognitive  pretraining  also  encompasses  any  form  of 
instructions  or  directions  given  to  Ss  prior  to  their  performance  of  an 
experimental  task.  Most  experimentation  on  perceptual  motor  skill 
learning  involves  the  use  of  apparatus  generally  unfamiliar  to  _Ss.  In 
order  to  insure  proper  use  of  the  "hardware"  Ss,  therefore,  receive  what 
is  commonly  referred  to  as  "experimental  instructions."  Relatively  few 
researchers  have  concerned  themselves  with  the  effects  of  these  instruc- 
tions as  an  independent  variable. 

Renshaw  and  Postle  (1928)  investigated  rotary  pursuit  tracking 
under  three  types  of  instruction.  One  group  received  instruction  de- 
scribing merely  the  task  objective.  A second  group  received  the  task 
objective  and  was  urged  to  analyze  the  task  (in  writing)  between  sittings 
on  consecutive  days.  The  third  group  received,  before  each  sitting,  the 
task  objective  and  carefully  prepared  instructions  "which  described  in 
detail  all  the  known  facts  about  the  nature  of  the  task,  its  difficul- 
ties, the  best  methods  of  operation,  etc.  "S_s  in  the  latter  condition 
performed  significantly  worse  over  25  trials  on  5 days  than  either  the 
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’Objective  Only'  or  the  'Analyzer'  groups.”  Noble,  Alcock  and  Farese 
(1958)  used  a task  requiring  series  of  discrete  motor  responses  to 
series  of  discrete  stimulus  presentations  with  two  levels  of  specificity 
of  instructions.  S>s  receiving  instruction  containing  the  task  objective, 
instructional  cues  on  how  to  attain  it,  and  verbal  examples  exhibited  a 
significantly  higher  probability  of  a correct  response  than  .Ss  who  re- 
ceived the  task  objective  only.  Noble,  Alcock  and  Frye  (1959)  corrobo- 
rated this  finding  with  a discrimination  reaction  time  task.  Ss  receiv- 
ing specific  instructions  and  six  practice  trials  had  a significantly 
shorter  reaction  time  R£  over  160  trials  than  £s  receiving  the  task 
objective  only  and  no  practice  trials.  The  findings  of  Noble  and  Alcock 
(1958,  1959)  are  essentially  in  agreement  with  the  findings  of  McFann 
(1953),  who  observed  greater  facilitation  and  less  interference  on  re- 
learning when  Ss  received  specific  information  as  to  how  an  intermediate 
task  differed  from  the  original  task. 

The  findings  of  Renshaw  and  Noble  et  al.  do  not  necessarily  contra- 
dict each  other.  Ss  in  the  specific  instruction  condition  of  Renshaw' s 
study  received  not  only  specific  instructions  but  also  a large  amount  of 
information  which  was  irrelevant  with  respect  to  the  actual  performance 
of  the  task.  It  may  be  surmised  that  these  irrelevant  instructions  had 
the  same  effect  as  non-specific  instructions  in  Noble's  experiment:  they 

may  have  led  to  the  elicitation  of  competing  responses.  Translated  into 
the  vocabulary  of  information  theory  the  interpretation  would  be  that 
irrelevant  or  non-specific  instructions  increase,  instead  of  reduce, 
task  information.  However,  any  attempt  to  interpret  these  studies  from 
the  vantage  point  of  some  unifying  theory  is  greatly  hampered  by  the  lack 
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of  a consistent  operational  definition  of  the  variable  "Instructions." 
The  differences  in  the  tasks  employed  compound  this  difficulty. 
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Summary 


Theoretical  considerations  as  well  as  an  analysis  of  current  in- 
structional materials  led  to  a set  of  assumptions  concerning  the  design 
of  procedures  and  materials  for  the  teaching  of  perceptual  motor  skills. 
Briefly  stated  these  assumptions  are: 

(1)  A cognitive  pretraining  phase  should  precede  perceptual  motor 


training. 

(2)  Cognitive  pretraining  can  be  defined  in  terms  of  the  variable 
Instructional  Cue. 

(3)  Instructional  Cues  can  be  operationally  defined  and  developed. 
Experimental  research  concerned  with  mental  practice,  verbal  pretraining 
and  differential  instructions  clearly  supports  the  first  two  assumptions. 
It  also  furnishes  some  indication  that  the  third  assumption  is  tenable 
and  which  directions  an  operational  definition  would  have  to  follow. 

On  the  basis  of  this  theoretical  and  empirical  background^it  was 
possible  to  define  two  levels  of  the  variable  Instructional  Cue.  The 
two  levels  were  tested  experimentally  for  their  effectiveness  as  cogni- 
tive mediators  of  perceptual  motor  behavior.  The  results  of  this  experi- 
ment as  well  as  the  findings  of  verbal  pretraining  research  suggest  that 
the  facilitative  effect  of  cognitive  pretraining  is  at  least  partially  a 
function  of  the  degree  of  cognitive  mastery  (M)  attained  by  the  learner 
as  a result  of  pretraining.  Cognitive  mastery  in  turn  is  dependent  on 
the  type  of  instructional  cue  (IC)  and  on  the  amount  of  practice  (P)  ' — =*■ 
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'-^administered  during  pretraining.  Pretraining  on  relevant  and  logically 
coherent  cues  appears  to  result  in  higher  levels  of  cognitive  mastery  as 
well  as  perceptual  motor  performance  (PM)  than  pretraining  on  irrelevant 
and  logically  incoherent  cues.  The  amount  of  cognitive  practice  incor- 
porated in  pretraining  also  appears  to  relate  directly  to  cognitive 
mastery  as  well  as  perceptual  motoV  performance.  If,  therefore,  either 
of  these  variables  influence  cognitive  mastery  and/or  perceptual  motor 
performance,  it  would  be  reasonable  to  expect  interactive  effects. 


Variables  and  Hypotheses 

The  present  study  was  designed  to  investigate  these  relationships 
using  the  following  operational  definitions  and  hypotheses: 

Independent  Variables 

(1)  Type  of  Instructional  Cue  (IC) 

Levels : 

(a)  CC:  Currently  operational  cues 

(b)  SC:  Systematically  developed  cues 

The  two  sets  of  cues  are  based  on  those  used  during  the  pilot 

study. 

(2)  Amount  of  Practice  (P) 

Levels : 

(a)  Low:  1 mastery  item  for  each  of  six  subsets  of  cues 

(b)  High:  3 (identical)  mastery  items  for  each  of  six  subsets 

of  cues. 
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Dependent  Variables 

1 Cognitive  Mastery  (M) : Number  of  errors  on  a written  posttest 

administered  immediately  after  pretraining. 

2 Perceptual-Motor  Performance  (PM) : Mean  number  of  flight  para- 

meters within  criterion  limits  per  unit  of  time. 


Hypotheses 

A.  Effects  of  Instructional  Cues  and  Practice  on  Cognitive  Mastery 

H^:  Pretraining  incorporating  systematically  developed  cues 

will  result  in  higher  cognitive  mastery  than  pretraining 
incorporating  currently  operational  cues. 

Pretraining  incorporating  a high  level  of  practice  will  re- 
sult in  higher  cognitive  mastery  than  pretraining  with  a 
low  level  of  practice. 

There  will  be  a significant  interaction  effect  on  cognitive 
mastery  for  two  levels  of  practice  and  two  levels  of  in- 
structional cues. 

B.  Effects  of  Instructional  Cues  and  Practice  on  Perceptual-Motor 
Performance 

H^:  Pretraining  incorporating  systematically  developed  cues 

will  result  in  better  perceptual  motor  performance  than 
pretraining  incorporating  currently  operational  cues. 

H5:  Pretraining  incorporating  a high  level  of  practice  will 

result  in  better  perceptual-motor  performance  than  pre- 
training with  a low  level  of  practice. 


H6!  T*iere  be  a significant  interaction  effect  on  percep- 


tual-motor performance  for  two  levels  of  practice  and  two 
levels  of  instructional  cues. 

C.  Relationship  between  cognitive  mastery  and  perceptual-motor 
performance 

There  will  be  a significant  positive  correlation  between 
cognitive  mastery  and  perceptual-motor  performance. 


Method 


Subjects 

Student  pilots  from  two  flights  of  the  USAF  training  Installation 
at  Williams  AFB  constituted  the  available  subject  pool.  A sample  of 
N * 45  Ss  were  selected  from  this  pool  on  the  basis  of  least  flight  ex- 
perience prior  to  UPT  (limit:  250  hours).  Ss  were  randomly  assigned 

from  an  alphabetized  list  to  one  of  five  groups  (four  experimental 
groups,  one  independent  control  group). 

The  sample  was  diminished  by  a total  of  six  Ss  before  and  during 
the  experiment.  Three  Ss  were  eliminated  prior  to  experimentation  due 
to  scheduling  problems  (2)  and  sickness  (1) . One  S_  did  not  understand 
experimental  instructions  and  two  Ss  could  not  be  processed  due  to  equip- 
ment breakdowns.  The  final  distribution  of  the  remaining  S * 39  Ss  was 
n = 8 for  groups  A through  D and  n * 5 for  group  E. 

Three  subject  characteristics  were  assumed  to  be  related  to  per- 
formance in  the  simulator: 

(1)  number  of  hours  in  the  simulator 

(2)  number  of  hours  in  the  airplane 

(3)  number  of  hours  of  training  prior  to  UPT. 

Data  on  these  and  ocher  subject  characteristics  are  listed  in  Appendix  A. 
These  data  show  that  the  groups  were  equivalent  with  respect  to  the 
first  two  criteria  mentioned  above  as  well  as  with  respect  to  age.  The 
groups  were  significantly  different  with  respect  to  the  third  criterion: 
number  of  hours  of  training  prior  to  UPT.  The  potential  impact  of  dif- 
ferences on  this  criterion  is  difficult  to  estimate  since  this  variable 
is  confounded  with  others,  such  as  the  type  and  the  recency  of  prior 
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training.  It  was,  therefore,  decided  not  to  match  the  groups  on  this 
variable,  but  to  use  covariance  procedures  if  indicated  by  the  data. 

The  use  of  human  subjects  in  this  study  was  in  accordance  with 
policies  and  regulations  published  by  the  Dissertation  Committee 
(p.  32)  at  Arizona  State  University.  All  Ss  were  informed  of  the  pro- 
cedure (Appendix  B)  and  signed  their  consent  prior  to  experimentation 
(Appendix  C) . 

Apparatus 

A flight  simulator  (A/F37A/T4-G  SINGER-LINK)  for  the  Cessna  T-37A 
was  used  for  the  performance  of  the  flight  task. 

An  Incre-Logger  Model  4409  Data  Recorder  using  precision  cassette 
tapes  was  connected  to  the  T4-G  computer,  taping  the  output  voltages  for 
the  airspeed  indicator,  the  attitude  indicator,  the  vertical  velocity 
indicator,  the  altimeter  and  the  tachometers.  The  Incre-Logger  was  set 
to  scan  all  six  channels  at  a rate  of  one  scan  per  second. 

Pretraining  was  administered  in  an  isolated  study  carrel  located  in 
the  same  room  as  the  simulator  (Appendix  D). 

Treatment  Materials 

Treatments  for  all  four  experimental  groups  consisted  in  linear 
self-instructional  programs  on  the  maneuver  Vertical  S-A  developed  on 
the  basis  of  materials  used  in  prior  experimentation.  The  programs  were 
identical  in  structure  (Appendix  E),  i.e.,  all  programs  had  the  same  in- 
troductory section  on  the  maneuver,  the  same  division  by  maneuver  seg- 
ments and  equivalent  mastery  items  requiring  an  overt  (pencil)  response. 
Feedback  is  provided  after  each  response.  The  programs  differ  only  in 
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the  sets  of  Instructional  ues  per  segment  and  in  the  number  of  mastery 
items  per  segment.  Each  program  includes  a posttest  at  the  end.  The 
posttest  is  identical  for  all  four  versions.  A sample  program  can  be 
found  in  Appendix  F 

The  program  for  the  control  group  had  the  same  introductory  section 
as  the  four  experimental  programs.  This  section  was  followed  by  blank 
pages  cn  which  the  students  were  to  write  in  their  own  words  the  steps 
they  would  follow  in  executing  the  maneuver. 

The  development  of  the  two  levels  of  each  of  the  two  independent 
variables  is  described  below. 

Levels  of  Instruction  Cue.  The  levels  of  this  variable  were  deve- 
loped on  the  basis  of  extensive  analytical  work.  Experimentation  con- 
trasting the  transfer  effects  of  either  level  demonstrated  the  validity 
of  the  operational  definitions  and  clearly  established  the  power  of  the 
variable  as  well  as  the  possibilities  for  its  systematic  manipulation. 

The  set  of  Currently  Operational  Cues  was  developed  from  current 
instructional  materials.  Briefings  on  the  Vertical  S-A  maneuver  given 
by  eight  different  Instructor  Pilots  were  covertly  recorded  in  the 
normal  instructional  environment,  i.e.,  on  the  flight  line.  Transcrip- 
tions of  all  eight  briefings  were  then  distributed  to  four  judges  who 
independently  identified  the  instructional  cues  contained  in  the  brief- 
ings. Even  though  the  judges  differed  greatly  in  terms  of  subject-matter 
knowledge,  they  agreed  on  better  than  80%  of  the  cues  identified.  A 
stratified  ranGom  sample  drawn  from  the  pool  of  cues  thus  identified  con- 
stituted the  set  of  Current  Operational  Cues. 
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The  set  of  Systematically  Developed  Cues  was  developed  with  the  aid 
of  a maneuver  analysis  (Brecke  et  al,  1972;  Gerlach  et  al,  1972).  This 
analysis  specifies  three  classes  of  information  for  every  maneuver  seg- 
ment: Aircraft  Parameters,  Control  Parameters  and  Information  Sources. 

The  procedure  is  replicable  and  generalizable  to  other  maneuvers.  Cues 
are  then  generated  by  applying  a quasi-algorithmic  procedure  to  the  com- 
prehensive and  precise  information  base  generated  by  the  analysis.  Four 
sets  of  cues  generated  independently  by  four  different  instructional  de- 
sign experts  were  highly  consistent  in  terms  of  cue  content  and  somewhat 
less  consistent  in  terms  of  syntax.  The  most  concise  formulations  were 
combined  into  one  list  which  was  then  subjected  to  four  revision  cycles, 
during  actual  maneuver  performance  were  anlyzed  and  incorporated. 

The  sets  of  currently  operational  cues  and  systematically  developed 
cues  (Appendix  G)  are  numerically  equivalent.  They  represent  the  subject 
matter  core  for  the  instructional  programs. 

Levels  of  Practice.  The  two  levels  represent  both  the  minimal  and 
the  maximal  amount  of  practice  which  appear  to  be  feasible  with  the  type 
of  programmed  instructions  (P.I.)  selected.  During  the  formative  stages 
of  the  program  development  it  became  apparent  that  at  least  one  mastery 
item  per  segment  set  was  necessary  to  produce  posttest  scores  in  the 
neighborhood  of  50%.  More  than  three  identical  mastery  items  were  not 
feasible  due  to  time  constraints. 

Program  Development  and  Validation.  The  programs  were  developed  on 
the  basis  of  the  following  objective: 
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"The  learner  can  name  in  writing  the  set  of  cues  for  the  instruc- 
tional maneuver  'Vertical  S-A'  in  correct  order." 

Enroute  objectives  called  for  the  same  "naming  in  order"  response 
but  for  the  subsets  of  cues  of  the  individual  maneuver  segments. 

Objectives  calling  for  learners  to  apply  the  cues  to  such  stimuli 
as  a pictorial  or  photographic  representation  of  the  instrument  panel 
would  have  required  different  practice  items  for  different  levels  of  IC. 
Since  the  inclusion  of  non-equivalent  practice  items  might  have  repre- 
sented an  uncontrolled  source  of  variance  it  was  decided  to  restrict  the 
program  objectives  to  naming  behaviors  only. 

The  programs  were  duplicated  and  assembled  in  a spiral-bound  booklet 
(8.5  x 11  inches)  and  then  subjected  to  three  cycles  of  test  and  revision. 

The  first  formative  evaluation  was  conducted  with  the  program  for 
the  Systematic  Cues/Low  Practice  condition  (Treatment  A) . One  S_  parti- 
cipated in  this  exploratory  trial  which  was  conducted  as  a frame-by-frame 
discussion.  S^  was  naive  with  respect  to  the  subject  matter  (especially 
the  aeronautical  terminology),  but  non-naive  with  respect  to  the  design 
of  instruction.  No  posttest  was  administered.  A number  of  inconsisten- 
cies of  expression  and  other  technical  shortcomings  were  discovered.  S. 
commented  explicitly  on  the  lack  of  feedback.  Program  revisions  after 
this  initial  tryout  were  restricted  to  the  removal  of  the  technical  short- 
comings only. 

The  second  formative  evaluation  was  conducted  with  the  same  program 
version  using  two  Ss  from  the  AFROTC  unit  at  Arizona  State  University. 

Both  of  these  subjects  had  gone  through  the  Flight  Indoctrination  Pro- 
gram offered  by  ROTC  and  were  familiar  with  the  specialized  terminology. 
Both  Ss  were  naive  with  respect  to  instructional  design.  Ss  were 
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instructed  to  work  through  the  programs  at  their  own  "comfortable"  rate. 
No  aid  was  given.  During  the  test  both  Sis  were  under  constant  observa- 
tion. No  posttest  was  administered.  Ss  finished  the  program  ^ *2  and 
51  minutes.  Both  Ss  showed  a very  positive  affective  response  to  the 
program  as  a whole  and  made  unsolicited  comments  on  the  usefulness  of 
the  illustrations.  Both  Ss  suggested  that  feedback  be  added. 

The  programs  were  revised  to  include  feedback  (KCR)  after  each 
learner  response.  A posttest  was  added  at  the  end  of  each  program.  A 
complete  list  of  the  changes  resulting  from  the  first  two  program  evalu- 
ations is  found  in  Appendix  H. 

A stimmative  evaluation  test  was  conducted  with  all  four  program 
versions  using  a total  of  eight  ROTC  students:  two  in  each  condition. 
These  Ss  were  very  similar  to  the  target  population  (UPT  students)  with 
respect  to  age  and  flight  experience.  Ss  were  instructed  to  work  at 
their  own  rate  and  to  take  the  posttest  immediately  upon  completion  of 
the  program.  The  results  of  this  evaluation  (Table  1)  corresponded  to 
expected  hypothetical  outcomes.  Ss  receiving  Current  Operational  Cues 
required  more  practice  to  reach  the  same  performance  level  (number  of 
errors  on  the  posttest)  as  Ss  receiving  Systematically  Developed  Cues. 

The  times  for  program  completion  were  judged  to  be  within  acceptable 
limits . 

The  programs  still  had  one  serious  shortcoming.  The  paper  was  so 
thin  that  it  was  possible  to  see  the  KCR  on  the  next  page.  The  problem 
was  solved  by  inserting  a page  of  blue  paper  between  each  response  frame 
and  the  following  feedback  frame  (omitted  in  the  sample  program  in  Appen- 


dix E). 
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Design 

A 2 x 2 factorial  posttest-only  design  with  an  independent  control 
group  was  employed.  The  design  is  illustrated  in  Table  2.  A pretest  on 
the  perceptual  motor  task  used  in  the  experiment  was  not  possible  due  to 
logistical  constraints. 

This  design  permits  testing  of  all  listed  hypotheses,  but  it  does 
not  allow  direct  evaluation  of  the  effects  of  Instructional  Cues  alone. 

On  the  basis  of  prior  experimentation, it  was  considered  impossible  to 
produce  sufficient  learning  of  the  cues  without  some  form  and  amount  of 
overt  cognitive  practice. 

This  design  probably  resulted  in  some  posttest-treatment  interaction 
even  though  the  learners  received  no  feedback  from  the  posttest.  In  the 
judgment  of  the  writers,  the  threat  to  external  validity  resulting  from 
the  posttest  is  outweighed  by  the  insights  gained  from  a test  of  the 
relationship  between  cognitive  mastery  and  perceptual  motor  performance. 

Procedure 

Experimentation  was  conducted  during  the  period  from  March  6 to 
March  18,  1974,  at  the  Human  Resources  Laboratory  at  Williams  AFB.  Ss 
were  normally  scheduled  one  hour  apart.  An  average  time  of  one  hour  and 
20  minutes  was  required  to  process  one  S_  through  the  experiment,  so  that 
there  were  usually  two  S_s  present:  one  in  the  simulator  and  one  in  the 
study  carrel.  One  experimentor  (E)  could  easily  direct  the  flow  of  Ss 
and  monitor  the  data  collection. 

Upon  reporting  to  E the  subject  went  through  the  following  procedure: 

(1)  Cognitive  pretraining.  E,  placed  S_  in  the  study  carrel  and  in- 
structed S to  first  read  the  sheet  entitled  "for  Your  Information" 
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(Appendix  B) , then  sign  his  consent  (Appendix  C)  and  then  start  working 
through  the  program.  S.  was  told  to  mark  the  time  he  began  to  work  on 
the  program  and  the  time  he  finished  the  program. 

(2)  Cognitive  posttest.  S.  took  the  cognitive  posttest  immediately 
upon  completion  of  the  program.  S.  again  had  to  mark  the  time  when  he 
finished  the  posttest. 

(3)  Perceptual  motor  training.  Immediately  upon  completion  of  the 

cognitive  posttest  S.  walked  over  to  the  simulator  and  handed  his  pro- 
grammed booklet  with  the  posttest  to  12.  ]2  then  checked  whether  the 

times  had  been  marked  as  instructed  and  had  _S  take  a seat  in  the  simula- 
tor (left  seat).  The  simulator  was  in  "FREEZE"  condition  at  15,000  feet, 
160  knots,  360®  and  81%  RPM.  After  a standard  headset  communication 
check,  S.  was  told  (in  a standard  conversation)  to  get  comfortable,  to 
adjust  the  rudder  pedals  and  to  use  a light  touch  on  the  stick  (Appendix 
I) . The  hood  was  then  lowered  and  locked  to  reduce  environmental  inter- 
ference and  S.  assumed  control  of  the  simulator  after  E.  had  released  the 
FREEZE  switch. 

E started  the  recorder  and  _S  then  flew  straight  and  level  for  five 
minutes.  After  five  minutes,  S.  started  the  first  Vertical  S-A  maneuver. 
Upon  finishing  the  maneuver  S.  flew  straight  and  level  for  one  minute  and 
then  started  his  next  Vertical  S,  repeating  this  sequence  until  six 
maneuvers  were  completed.  The  recorder  was  left  on  throughout  this 
period  up  to  the  completion  of  the  last  maneuver.  E also  kept  a Sub- 
ject Master  Sheet  and  a Protocol  Sheet  during  this  time  (Appendix  J) . 

(4)  After  the  sixth  trial,  the  simulator  was  again  put  into  the 
"FREEZE"  condition.  j3  left  the  simulator  and  answered  a brief  question- 
naire (Appendix  R)  designed  to  obtain  some  indication  of  S.' s retention 
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of  instructional  cues  as  well  as  to  elicit  some  comment  and  critique  of 
the  pretraining  procedures  and  materials.  Upon  completion  of  the  ques- 
tionnaire, S>  was  dismissed. 

Data  Collection  and  Analysis 

Cognitive  mastery  M was  operationally  defined  as  the  number  of 
errors  on  the  cognitive  posttest.  This  test  was  scored  independently 
by  two  judges  using  an  algorithm  in  conjunction  with  a key  for  each  of  the 
the  two  levels  of  cues  (Appendix  L).  This  procedure  ensured  a highly 
objective  measure  free  of  any  scorer  bias.  The  judges  arrived  at  the 
same  scores  in  each  and  every  case. 

Perceptual  motor  performance  indexes  were  computed  on  the  basis  of 


six  measures: 

(1) 

Airspeed 

(2) 

Heading 

(3) 

Altitude 

(4) 

Vertical  Velocity 

(5) 

Pitch  Attitude 

(6) 

Power 

These  measures  were  obtained  automatically  at  one  second  intervals  by 
taping  the  analog  input  to  the  appropriate  instruments.  The  recorder 
(see  p.  25)  converted  the  analog  voltages  to  digital  signals  and  re- 
corded these  on  precision  cassette  tape.  This  data  collection  procedure 
resulted  in  an  extremely  precise  and  complete  performance  record  as  long 
as  the  equipment  was  functioning  properly.  Equipment  malfunctions  were 
encountered  on  some  of  the  subject  records.  These  malfunctions  always 
resulted  in  an  intermittent  failure  to  record  data.  The  failure  periods 
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lasted  an  average  of  3 scans.  In  order  to  compensate  for  this  loss  of 
data, an  interpolation  algorithm  was  developed  and  validated  using  com- 
plete data  sets  as  testing  criterion.  All  of  the  missing  data  could 
thus  be  recovered  with  a very  high  degree  of  reliability.  A typical 
trial  record  before  and  after  the  data  recovery  procedure  is  shown  in 
Figure  2. 

The  performance  records  obtained  in  this  manner  provided  the  raw 
data  for  the  computation  of  three  different  indices  of  overall  perform- 
ance quality: 

(1)  Time  on  criteria:  Percent  of  total  trial  time  S.  was  within 

criterion  limits  averaged  over  all  six  measures. 

(2)  Hit  Rate:  Average  number  of  criteria  on  which  S_  was  within 

limits  at  any  point  during  a maneuver. 

(3)  Error  Amplitude:  Inverse  Hit  Rate  combined  with  the  average 

error  magnitude. 

The  computation  of  these  indices  as  well  as  the  automatic  recording 
of  the  complete  performance  history  as  outlined  above  were  outcomes  of 
prior  work  on  the  research  project  of  which  this  report  is  a part. 

They  are  described  in  complete  detail  in  Shipley,  Gerlach  and  Brecke, 

1974. 

The  same  is  true  for  the  data  analysis  procedures  which  were  employed 
in  this  study.  With  the  exception  of  the  data  on  cognitive  mastery  M and 
subject  characteristics,  all  data  were  processed  and  analyzed  by  using 
MANOVA  procedures  and  computer  programs  which  had  been  developed  prior  to 
this  study.  A complete  description  and  evaluation  of  these  procedures  is 
also  found  in  Shipley  et  al,  1974. 


Figure  2:  Closed  Loop  Control  System:  Pilot  - Aircraft 
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Results 


It  was  hypothesized  that  transfer  from  cognitive  pretraining  to 
perceptual  motor  performance  on  a standard  instrument  flight  task 
would  be  a function  of  the  type  of  instructional  cues  and  the  amount 
of  practice  incorporated  in  cognitive  pretraining. 

A third  factor  which  could  be  assumed  to  contribute  to  differential 
performance  quality  was  the  flight  training  history  of  the  subjects.  The 
experimental  groups  were  found  to  be  equivalent  in  terms  of  age,  hours 
on  the  T-37  airplane  and  hours  on  the  T-4  simulator.  The  groups  were  not 
equivalent  with  respect  to  the  number  of  hours  of  flying  time  logged 
prior  to  entering  USAF  training.  By  coincidence,  the  group  differences 
were  such  that  the  groups  which  received  systematic  cues  also  had 
significantly  more  prior  flight  experience,  F'(l,  28)  * 12.17,  £ < .01. 

In  order  to  adjust  for  the  potential  effect  of  the  unequal  hours 
of  prior  flying  time,  analysis  of  covariance  procedures  seemed  to  be 
indicated  for  the  perceptual  motor  performance  data.  Several  reasons, 
however,  led  to  the  rejection  of  covariance  analysis  in  favor  of  normal 
analysis  of  variance  procedures. 

1.  Pearson  product  moment  correlation  coefficients  were  computed 
between  three  subject  characteristics  including  hours  of  prior  flying 
time  and  the  scores  on  three  composite  perceptual  motor  performance 


descriptors  both  for  the  straight  and  level  warm-up  period  and  for  the 
Vertical  S trials  portion  (see  Tables  3 and  4).  None  of  the  correlations 
reached  r = .6,  the  pre-established  criterion  for  covariance  procedures 
(see  p.  32) . 


Table  4 


Correlations  between  Subject  Characteristics  and 
Perceptual  Motor  Scores  (Means  over  Trials) 
for  the  Vertical  S Trials  Portion 


Performance  descriptors 


Subject  Error  Hit  Percent  time 

characteristics  amplitude  * rate  on  criterion 


Hours  of  prior 
flying  time 

-.023 

-.072 

.011 

Hours  on  T-37 
(airplane) 

1 

O 

.089 

% 

.067 

Hours  on  T-4 
(simulator) 

-.422* 

\ 

.2^6 

.372 

/ 


I 

J 

1 


1 


— 

41 

2.  The  one  significant'  correlation  for  error  amplitude  during 

the  straight  and  level  portion  oust  be  considered  inconclusive  since  none 
of  the  other  composite  performance  descriptors  show  correlations  which 
come  close  to  significance  (r  > . 268) . The  correlations  with  the 
average  trial  performance  scores  are  lower  yet  (Table  5) , and  in  this 

1 

m 

portion  of  the  simulator  performance,  error  amplitude  does  not  correlate 

] 

at  all  with  hours  of  prior  flying  time. 

3.  The  perceptual  motor  performance  data  showed  heterogeneous 
group  variances.  While  it  is  known  that  the  P-test  of  an  analysis  of 
variance  is  relatively  robust  with  respect  to  violations  of  the 
assumption  of  homogeneity  of  variance,  it  has  been  shown  (Elashoff,  1969) 
that  analysis  of  covariance  procedures  are  far  less  robust  against 
violations  of  this  assumption. 

4.  The  highest  correlations  were  found  for  hours  on  the  T-4 
simulator  and  perceptual  motor  performance  both  for  the  warm-up  and 
for  the  trials  portion.  Hours  on  the  T-4  would  therefore  be  a more 
reasonable  covariate  than  hours  of  prior  flying  time.  The  groups  were, 
however,  equivalent  with  respect  to  this  characteristic. 

5.  Hours  of  prior  flying  time  is  a very  incomplete  indicator  of 
pilot  experience  since  it  takes  into  account  neither  the  type  of  flight 
training  (private,  commercial,  military,  single  or  multi-engine)  nor 
the  recency  of  such  tra’inlng’.  The"  potential  effects  of  50  "hours  of 
helicopter  training  two  years  before  the  experiment  cannot  be  equated 
with  50  hours  of  military  single  engine  light  plane  training  one-half 
year  before  the  experiment. 
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The  reasons  deed  above  were  considered  ample  justification  for  the 
choice  of  normal  analysis  of  variance  procedures.  In  all  analyses, 
the  2x2  design  was  analyzed  first.  Then,  comparisons  between  the 
independent  control  group  and  the  four  experimental  groups  were 
performed  where  appropriate,  using  Dunnett's  Test  (Myers,  1966,  p.  337). 


Cognitive  Performance 


Cognitive  mastery  as  measured  by  percent  correct  scores  cn  the 
immediate  posttest  showed  a significant  instructional  cues  effect, 

F (1,  28)  * 8.24,  £ < .01.  Subjects  who  had  received  systematic  cues 
achieved  higher  scores  on  the  immediate  posttast  than  those  who  had 
received  current  cues.  Practice  effects  were  not  significant;  neither 
were  the  interactions. 

Measures  of  time  through  program  and  time  through  posttest  showed 
significant  effects  for  practice,  but  not  for  instructional  cues. 
Subjects  who  had  received  a high  amount  of  practice  spent,  of  course, 
more  time  working  through  the  program,  £ (1,  28)  = 39.65,  £ < .0001, 
however,  they  spent  significantly  less  time  in  completing  the  posttest, 
F (1,  28)  * 6.04,  £ < .05.  Interactions  were  not  significant. 

Program  efficiency , measured  as  the  quotient  between  percent 
correct  on  the  posttest  and  time  through  program  in  minutes .showed  a 
significant  practice  effect,  £ (1,  28)  * 15.24,  £ < .001.  Subjects 
in  the  low  practice  conditions  made  more  correct  responses  on  the 
posttest  per  minute  of  invested  learning  time  than  subjects  in  the 
high  practice  conditions. 
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Group  means  for  cognitive  performance  measures  are  shown  In 
Table  5.  Raw  data  and  analysis  of  variance  tables  are  included  in 
Appendix  P . 

Perceptual  Motor  Performance  — 


It  will  be  recalled  that  perceptual  motor  performance  was  measured 
by  recording  the  actual  indications  of  six  cockpit  instruments.  The 
altitude  record  was  later  found  to  be  too  noisy  and  was  dropped  from 
further  analysis.  From  the  raw  data  on  the  remaining  five  variables, 
three  different  types  of  derived  scores,  called  performance  descriptors, 
were  computed.  This  resulted  in  15  single  variable  performance  descriptors 
which  could  be  summed  across  variables  into  the  three  composite  perform- 
ance descriptors  T , H and  E (see  Table  3,  p.  49). 

w w Zj 

Analysis  of  variance  procedures  were  applied  to  all  15  single 
variable  scores  as  well  as  to  the  three  composite  performance  scores. 
Separate  analyses  were  conducted  for  the  straight  and  level  warm-up 
portion  and  for  the  six  Vertical  S trials.  This  amounts  to  a total  of 
32  separate  analyses  of  variance.  Since  analyses  on  single  variable 

scores  permit  evaluation  of  only  one  of  five, recorded  variables  of 
pilot  performance  at  one  time,  primary  consideration  is  given  to 
reporting  the  results  in  terms  of  composite  performance  descriptors. 


Straight  and  Level  Warm-Up.  A significant  cues  effect  favoring  SC 
was  found  for  error  amplitude,  E^,  F (1,  28)  - 5.22,  £ 4.05.  No  other 
comparisons  between  the  experimental  groups  were  significant.  Dunnett's 
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Table  5 


Group  Means  for  Cognitive  Performance  Measures 


Groups 

n 

Percent 
correct  on 
posttest 

Time 

through 

programa 

Time 

through 

posttest3 

Program 

efficiency 

index 

Systematic  cues 

Low  practice 

8 

78. 5A 

23.13 

8.75 

3.30 

High  practice 

8 

86.32 

44.38 

6.88 

2.01 

Current  cues 

low  practice 

8 

61.84 

24.63 

8.50 

n — <" 

4*  / U 

High  practice 

8 

62.43 

40.50 

6.75 

1.76 

No  cues  (control) 

7 

— 

16.71 

— 

— 

ain  minutes 
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tests  comparing  each  of  the  experimental  groups  with  the  Independent  con- 
trol group  did  not  reveal  any  significant  differences. 

Mean  group  scores  on  the  three  composite  performance  descriptors 
are  shown  in  Table  6.  Analysis  of  variance  tables  are  Included  In 
Appendix  P.  


Vertical  S Trials.  In  order  to  obtain  information  about  the  effects 
of  instructional  cues  (Factor  A)  and  practice  (Factor  B)  over  the  course 
of  the  six  trials,  trials  was  included  in  the  analyses  of  this  portion  as 
a within-subjects  factor  (Factor  D) . Mean  group  scores  on  each  trial  for 
the  three  composite  performance  descriptors  are  shown  in  Table  7 through 
9 ; mean  group  scores  averaged  over  trials  are  shown  in  Table  10.  The 
analysis  of  variance  tables  are  shown  in  Table  11  through  13. 

Significant  trials  effects  were  found  for  error  amplitude, 

F (5,  140)  = 3.14,  £ < .05,  for  hit  rate,  F (5,  140)  = 9.57,  £ < -001, 

and  for  percent  time  on  criterion,  £ (5,  140)  - 5.50,  £<  .001. 

A significant  trials  x instructional  cues  interaction  was  found  for 

percent  time  on  criterion,  F (5,140)  * 2.49,  £ < .05. 

The  performance  curves  for  the  three  levels  of  instructional  cues 

over  six  trials  (representing  the  trials  x instructional  cues  interaction) 

are  shown  in  Figures  3,  4 and  5 for  each  of  the  composite  performs  ,e 

descriptors.  Linear  trend  contrasts  over  six  trials  between  systematic 

cues  and  current  cues  revealed  significant  differences  between  these 

two  levels  of  instructional  cues  for  error  amplitude,  £ (1,  28)  * 5.26, 

£ < .05,  and  for  percent  time  on  criterion,  F (1,  28)  ■ 9.31,  £ < .005. 

Group  performances  within  trials  were  evaluated  by  £ tests.  Significant 

differences  were  found  for  the  two  levels  of  instructional  cues  on  each 

of  the  three  composite  performance  descriptors  (see  Table  14). 
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Table  6 

Mean  Group  Scores  for  Perceptual  Motor  Performance 
during  Straight  and  Level  Warm-up 


Performance  descriptors 

Groups 

n 

Error 

amplitudea 

Hit 

ratea 

Percent  time 
on  criteriona 

Systematic  cues 

Low  practice 

8 

2.63 

2.69 

290.60 

High  practice 

8 

2.99 

3.03 

332.49 

Current  cues 

Low  practice 

8 

5.66 

2.62 

282.93 

High  practice 

8 

3.86 

2.85 

307.76 

No  cues 

7 

3.79 

2.96 

310.01 

^summed  across  variables 
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Table  7 

Mean  Group  Scores  for  Perceptual  Motor  Performance 
over  Six  Vertical  S Trials 
(Error  Amplitude)3 


Trials 

Groups 

n 

1 

2 

3 

4 

5 

6 

Systematic  cues 

Low  practice 

8 

5.57 

4.35 

4.75 

4.30  • 

4.52 

4.55 

High  practice 

O 

V 

6.19 

5.  22 

5.02 

5.05 

5.83 

8.73 

Current  cues 

Low  practice 

8 

9.87 

7.26 

5.95 

5.56 

6.28 

6.40 

High  practice 

8 

9.12 

7.54 

6.56 

5.80 

6.84 

5.49 

No  cues 

7 

5.19 

4.34 

4.58 

6.10 

4.67 

4.26 

3 summed  across  variables 
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Table  8 


Mean  Group  Scores  for  Perceptual  Motor  Performance 
over  Six  Vertical  S Trials 
(Hit  Rate)a 


Trials 

Groups 

n 

1 

2 

3 

4 

5 

6 

Systematic  cues 

Low  practice 

8 

2.37 

2.42 

2.77 

2.64 

2.66 

2.67 

High  practice 

O 

w 

2.12 

2.49 

2.45 

2 . 52 

2.46 

2.44 

Current  cues 

Low  practice 

8 

1.91 

2.12 

2.53 

2.65 

2.36 

2.56 

High  practice 

8 

1.87 

2.14 

2.34 

2.35 

2.22 

2.46 

No  cues 

7 

2.48 

2.56 

2.56 

2.51 

2.92 

2.88 

asummed  across  variables 
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Table  9 


Kean  Group  Scores  for  Perceptual  Motor  Performance 
over  Six  Vertical  S Trials 
(Percent  Time  on  Criterion)3 
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Table  10 

Mean  Group  Scores  for  Perceptual  Motor  Performance 
Averaged  over  Trials 
(All  Descriptors) 


Performance 

descriptors 

Groups 

n 

Error 

amplitude3 

Hit 

rate3 

Percent  time 
on  criterion3 

Systematic  cues 

Low  practice 

8. 

4.67 

2.62 

235.53 

High  practice 

8 

6.01 

2.41 

219.69 

Current  cues 

Low  practice 

8 

6.89 

2.35 

212.91 

High  practice 

8 

6.89 

2.23 

211.97 

No  cues 

7 

4.86 

2.65 

241.11 

a8ummed  across  variables 


t. 


Between 


Instruct,  cues  (A.) 
Practice  (B) 

A x B 
Error 

Within 
Trials  (D) 

D x A 
D x B 


D x A x B 
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Table  12 

of  Variance:  Hit  Rate  H^. 


ss 

df 

MS 

F 

£ 

55.99 

191 

.29 

30.72 

31 

.99 

2.46 

1 

2.46 

2.56 

.1172 

1.34 

1 

1.34 

1.40 

.2463 

.08 

1 

.08 

.09 

.7649 

26.84 

28 

.96 

25.27 

160 

.16 

6.13 

5 

1.23 

9.57 

.0000 

.55 

5 

.11 

.85 

.5164 

.56 

5 

.11 

.88 

.5028 

.083 

5 

.02 

.13 

.9835 

17.94 

140 

.128 
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Table  14 


£ tests  for  Groups  A & B (Systematic  Cues) 
versus  Groups  C & D (Current  Cues) 
for  Trials  1 and  2a 


Trials 


Composite 

performance 

descriptor  1 2 


Error 

t - 2.95 

t = 2.13 

amplitude 

£ < .05 

£ < .05 

Hit  rate 

Jt  “ 5.00 

t * 2.39 

£ < .001 

£ < .05 

Percent  time 

jt  = 3.58 

t = 2.49 

on  criterion 

£ < . 01 

£ < .05 

at_  tests  non-significant  for  all  contrasts  on 
Trials  3 through  6. 
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Figure  3.  Perceptual  motor  performance  as  measured  by  error 
amplitude  (scores  summed  across  variables)  for  three  levels  of  cues  over 
six  trials  (A  x D interaction). 
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Figure  5.  Perceptual  motor  performance  as  measured  by  percent 
time  on  criterion  (scores  summed  across  variables)  for  three  levels  of 
cues  over  six  trials  (A  x D interaction). 
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Dunnett's  tests  comparing  each  of  the  four  experimental  groups  with 
the  independent  control  group  revealed  no  significant  difference  between 
mean  performance  scores  over  all  six  trials.  When  performance  was 
compared  by  group  and  trial,  eight  out  of  a total  of  72  contrasts  were 
significant  at  £ < .05.  It  was  found  specifically  that  the  control 
group  showed  a significantly  better  performance  on  all  three  composite 
descriptors  during  Trial  1 than  the  groups  which  had  received  current 
cues  (six  contrasts) . On  Trial  6 the  control  group  exhibited  a 
significantly  better  performance  on  error  amplitude  and  percanc  time  on 
criterion  than  Group  B,  i.e.,  the  group  which  had  received  systematic 
cues  and  a high  level  of  practice  (two  contrasts). 

Correlations  between  Cognitive  Mas cerv  and  Perceptual  Motor  Performance 

Pearson  product  moment  correlation  coefficients  ware  computed 
between  percent  correct  scores  on  the  immediate  posttest  and  the  scores 
on  three  composite  perceptual  motor  performance  descriptors  on  each 
trial  (see  Table  15,).  A second  set  of  correlations  was  computed 
between  percent  correct  scores  on  the  immediate  post  test  and  the  scores 
on  three  composite  perceptual  motor  performance  descriptors  for  the 
straight  and  level  warm-up  period  and  for  Vertical  S trial  period 
averaged  over  the  trials  (see  Table  16) . None  of  the  correlations 
reached  the  .05  level  of  significance  (_r  f=,.263). 

Questionnaire 

Analysis  of  the  postexperimental  questionnaire  revealed  no 
distinguishable  differences  between  groups  in  the  answers  to  Questions  1 
through  6,  8,  9 and  11  through  14. 
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Table  15 

Correlations  between  Cognitive  Mastery 
and  Perceptual  Motor  Performance  on  Six  Trials 


Trials 

Composite 

performance 

descriptor 

1 

2 

3 

4 

5 

6 

Error 

amplitude 

.089 

.035 

-.019 

-.168 

-.004 

-.054 

Hit  rate 

.238 

-.106 

-.113 

-.003 

-.053 

-.097 

Percent  time 
on  criterion 

.012 

-.078 

-.113 

.194 

.028 

-.001 

Wi  * 
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Table  16 


Correlations  between  Cognitive  Mastery 
and  Perceptual  Motor  Performance 
during  the  Warm-up  and  during  the  Trial  Period 


Composite 

performance 

descriptor 

Straight  and  level 
warm-up  period 

Mean  performance 
over  six  trials 
of  Vertical  S 

Error  amplitude 

.046 

.034 

Hit  rate 

.047 

.064 

Percent  time 
on  criterion 

-.078 

.041 
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The  answers  to  Question  7 showed  an  effect  for  instructional  cues, 
F (1,  28)  » 7.29,  £ < .05.  Groups  which  had  received  systematic  cues 
reported  less  use  of  trim. 

In  Question  9 subjects  were  asked  to  rank  order  five  instructional 
procedures.  The  resulting  rank  order  based  on  the  responses  by  all 
subjects  regardless  of  group  is  shown  in  Table  17. 

In  Question  10  subjects  were  asked  to  rate  the  instructional 
treatments  they  had  received  d'-ring  cognitive  pretraining  on  four 
Likert  - type  scales  (1  » low,  5 ° high).  The  group  means  of  these 
ratings  are  shown  in  Table  18  together  with  the  mean  overall  ratings. 
Subjects  in  the  current  cues/high  practice  condition  rated  the  treat- 
ments significantly  lower  on  every  scale  except  on  usefulness  of 
drawings.  The  overall  rating  showed  a significant  practice  effect, 

F_  (1,  28)  * 5.20,  £ < .05,  and  a significant  instructional  cues  x 
practice  interaction  effect,  £ (1,  28)  = 7.26,  £ < .05,  both  of  which 
are  attributable  to  the  low  overall  rating  by  the  current  cues/  high 
practice  group.  The  latter  also  differed  significantly  from  the  control 
group,  F (1,  13)  = 12.43,  £<  .01. 
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Discussion 


The  primary  goal  of  the  present  study  was  the  identification  of 
variables  which  influence  transfer  from  cognitive  pretraining  to 
perceptual  motor  skill  acquisition.  The  results  clearly  support  the 
central  hypothesis  that  the  direction  of  transfer  is  dependent  on  the 
type  of  verbal  instructional  cues  which  were  learned  du.ring  cognitive 
pretraining.  Systematically  developed  instructional  cues  led  to  more 
precise  perceptual  motor  behavior  than  currently  operational  cues,  which 
appear  to  inhibit  rather  than  facilitate  performance.  The  results 
did  not  confirm  the  hypothesis  that  the  amount  of  cognitive  practice 
would  be  directly  related  to  the  amount  of  transfer.  Variations  in 
the  amount  of  cognitive  practice  did  not.  result  in  subsequent  variations 
of  perceptual  motor  performance. 

The  most  significant  specific  finding  of  the  cognitive  phase  of 
the  study  is  the  superior  posttest  performance  of  groups  which  had 
received  systematic  cues.  Subjects  in  this  treatment  condition  achieved 
posttest  scores  which  were  on  the  average  17  percentage  points  above 
those  of  subjects  who  had  received  current  cues.  These  higher  scores 
were  achieved  at  no  expense  in  terms  of  time  through  program.  It 
follows  that  systematic  cues  were  much  more  readily  retained  or,  to  put 
it  differently,  that  systematic  cues  may  be  considered  to  be  more 
efficient  verbal  cognitive  mediators  than  current  cues. 

The  amount  of  cognitive  practice  with  a given  set  of  cues  did  not 
influence  posttest  scores  but  it  did  lead  to  differences  in  posttest 
time.  Subjects  in  the  high  practice  conditions  had  significantly 
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shorter  posttest  times  than  subjects  in  the  low  practice  conditions. 

Since  the  posttest  consisted  of  a straightforward  reproduction  of  a 
list  of  cues,  this  result  shows  clearly  that  the  cues  were  more  readily 
recalled  by  subjects  in  the  high  practice  condition.  It  is  important 
to  note,  however,  that  greater  readiness  of  recall  does  not  entail 
greater  precision  of  recall.  Readiness  of  recall  or  cognitive  avail- 
ability of  cues  appeared  to  be  a function  of  practice,  whereas  precision 
of  recall  varied  with  the  type  of  instructional  cue. 

In  short,  both  independent  variables  resulted  in  significant 
cognitive  performance  differences.  The  results  of  the  perceptual 
motor  phase  of  the  study  show  partially  corresponding  performance 
differences,  indicating  partial  transfer  from  cognitive  learning  to 
perceptual  motor  skill  acquisition. 

The  two  levels  of  instructional  cues  which  led  to  differences  in 
the  precision  of  cognitive  performance  led  to  similar  differences  in  the 
precision  of  perceptual  motor  performance.  The  relatively  high  and  stable 
performance  of  the  systematic  cues  groups  contrasts  initially  with  the 
much  lower  and  gradually  increasing  performance  cf  the  current  cues 
groups.  By  Trial  4 all  experimental  groups  had  merged  at  a performance 
level  which  represents  a performance  ceiling  for  all  but  the  control  group. 

These  differential  performance  patterns  indicace  that  systematic  cues 
facilitate  perceptual  motor  performance  in  a way  which  permits  the 
learner  to  perform  at  or  near  ceiling  performance  from  the  beginning. 
Current  cues,  by  comparison,  initially  inhibit  performance.  This 
inhibiting  effect  gradually  disappears  as  indicated  by  the  gradual 
convergence  of  the  essentially  flat  performance  curves  (see  Figure  3 
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and  Figure  5 ) for  systematic  cues  and  the  steadily  ascending  curves 
for  current  cues.  In  the  absence  of  a true  zero  point  of  transfer 
effects  it  is  of  course  impossible  to  define  positive  or  negative 
transfer  effects  in  absolute  terms.  Statements  about  transfer  can 
therefore  only  be  made  in  relative  terms.  Thus,  relative  to  current 
cues,  systematic  cues  are  facilitative  or  show  positive  transfer  effects 
or,  relative  to  systematic  cues,  current  cues  are  inhibitory  or  show 
negative  transfer  effects. 

The  performances  of  the  control  groups  in  the  present  and  in  the 
preceding  study  (Brecke  et  al. , 1974)  add  some  reference  points  to 
these  considerations.  The  control  group  in  the  preceding  study  received 
merely  the  maneuver  objective  and  its  subsequent  perceptual  motor 
performance  was  at  the  same  level  as  that  of  the  current  cues  group. 

The  control  group  subjects  in  the  present  study  received  the  maneuver 
objective  and  were  asked  to  write  down  the  steps  they  would  follow  in 
executing  the  maneuver,  which  essentially  amounts  to  asking  the  subjects 
to  analyze  the  maneuver  and  to  supply  their  own  cues.  As  the  Figures 
3,  4 and  5 show,  the  control  group  in  the  present  study  performed  at  or 
above  the  performance  level  of  the  systematic  cues  group.  This  result, 
which  is  in  agreement  with  the  superior  performance  for  the  Analyzer 
group  in  the  study  by  Renshaw  et  al.  (1928) , provides  a positive 
boundary  value  of  transfer  with  respect  to  the  treatment  conditions 
investigated  so  far.  In  relation  to  this  boundary  value  systematic 
cues  can  be  considered  maximally  effective  mediators  of  perceptual 
motor  skill,  whereas  current  cues  must  be  considered  to  be  considerably 
less  effective.  The  assumption  that  the  direction  of  transfer  is  a 
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function  of  the  type  of  instructional  cue  is  therefore  supported  at 
least  in  relative  terns  by  the  results  of  this  study. 

The  two  levels  of  cognitive  practice  which  resulted  in  significantly 
different  degrees  of  cognitive  availability  of  a given  type  of  instruc- 
tional cues  did  not  lead  to  the  predicted  differences  in  perceptual 
motor  performance.  If  the  hypothesis  of  a direct  relationship  between 
amount  of  cognitive  practice  and  amount  of  transfer  would  have  been 
borne  out,  the  performance  differences  between  systematic  cues  and 
current  cues  would  have  been  smaller  for  low  practice  conditions  than 
for  high  practice  conditions.  The  results  did  not  show  any  significant 
performance  differences  due  to  practice  effects,  even  though  the  trial 
means  (Tables  7 through  9)  indicate  a tendency  towards  lower  performance 
levels  for  high  practice  conditions. 

It  is  speculated  that  the  failure  to  find  overall  significant 
effects  for  the  practice  variable  by.  regular  analysis  of  variance 
procedures  was  at  least  to  some  extent  a consequence  of  the  extreme 
instability  of  the  T-4G  simulator.  This  instability  led  to  an 
information  processing  load  which  was  considerably  higher  than  it  would 
have  been  if  the  simulator  would  have  reacted  like  the  real  aircraft  or 
the  regular  training  simulator.  Evidence  to  this  effect  are  the  answers 
to  Questions  11  and  12  of  the  questionnaire.  All  but  seven  of  the  39 
subjects  indicated  that  the  simulator  used  in  the  experiment  was 
"harder  to  fly"  than  either  the  aircraft  or  the  regular  training 
simulator.  Increased  information  processing  loads  led  to  the  common 
phenomenon  of  over-control,  which  in  turn  resulted  in  performance  variances 
high  enough  to  mask  out  any  existing  effects  of  the  practice  variable. 
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The  high  and  heterogeneous  variances  associated  with  the  perceptual 
motor  data  of  the  experimental  groups  also  provide  an  explanation  for  the 
lack  of  significant  correlations  between  cognitive  mastery  and  perceptual 
motor  performance. 

In  summing  up  the  outcomes  of  this  3tudy  with  respect  to  its  first 
objective,  the  following  statements  appear  justified: 

1.  The  results  shew  clearly  that  transfer  from  cognitive  pre- 
training to  perceptual  motor  learning  is  affected  by  the  type  of 
verbal  instructional  cue  learned  during  cognitive  pretraining. 

2.  The  results  of  the  study  provide  a baseline  for  the  investi- 
gation of  practice  as  a second  independent  and  manipulable  variable 
of  cognitive  pretraining.  Increased  levels  of  cognitive  practice 
appear  to  lead  to  greater  cognitive  availability  of  the  instructional 
cues  which  in  turn  should  lead  to  distinguishable  perceptual  motor 
performance  differences. 

3.  Instructional  cue  was  defined  as  an  independent  variable  on  the 
basis  of  a conceptual  framework  which  includes  both  information  theory 
and  control  theory.  The  results  indicate  that  this  conceptual  frame- 
work is  highly  appropriate  in  the  context  of  perceptual  motor  learning. 

4.  The  conceptual  framework  used  in  this  study  also  represents 

a common  denominator  for  the  several  research  approaches  to  the  problem 
of  the  cognitive  antecedents  of  perceptual  motor  learning  which  were 
discussed  in  Chapter  2. 

The  second  objective  of  the  study  was  the  discovery  and  validation 
of  prescriptive  principles  for  the  design  of  perceptual  motor  instruction. 
On  both  counts,  In  terms  of  validation  of  existing  design  principles 


as  well  as  in  terms  of  discovery  of  new  design  principles,  the  study 
resulted  in  the  attainment  of  the  secoad  objective. 

The  instructional  design  devices  which  were  used  in  the  preceding 
experiments  were  used  again  in  the  present  study.  The  same  maneuver 
analysis,  the  same  criteria  for  the  distinction  between  functional  and 
nonfunctional  cues  and  the  3ame  procedures  for  cue  generation  were 
employed  to  produce  a different  type  of  instructional  treatment.  In  the 
preceding  experiment  an  approximation  of  the  current  standard  USAF 
instructional  procedure  was  used  consisting  of  a prose  text  and  an 
instructor  briefing  which  was  simulated  by  a TV  presentation.  In  the 
present  study  the  instructional  treatment  consisted  of  programed 
instruction  without  a briefing.  The  predicted  instructional  effects 
were  in  both  cases  confirmed  by  the  experimental  results  which  amounts 
to  an  empirical  validation  of  the  design  devices  over  two  types  of 
instructional  treatments. 

The  results  of  the  study  also  provided  empirical  evidence  for  two 
previously  uninvestigated  considerations  for  the  design  of  perceptual 
motor  instruction. 

The  high  practice  version  of  the  instructional  treatments  was  created 
by  a straightforward  repetition  of  identical  mastery  items.  This  mani- 
pulation led  on  the  one  hand  to  a significant  decrease  of  the  instruc- 
tional efficiency  of  the  program  and  on  the  other  hand  to  negative 
attitudes  on  the  part  of  the  learners.  The  decrease  of  instructional 
efficiency  was  evidenced  by  the  sharp  increase  of  program  time  without 
concurrent  increase  in  posttest  scores.  Evidence  for  the  negative 
learner  attitudes  comes  primarily  from  the  significantly  lower  ratings 
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for  the  instructional  treatments  which  were  given  by  Group  D,  the  group 
which  received  current  cues  and  high  practice.  It  follows  that  instruc- 
tional programs  which  are  designed  to  provide  cognitive  pretraining  should 
not  incorporate  repetitive  practice  of  the  type  used  in  this  study. 

A second  consideration  for  the  design  of  perceptual  motor  instruction 
arises  out  of  the  performance  exhibited  by  the  control  group.  This  group 
showed  a very  high  performance  for  a very  low  investment  in  terms  of 
cognitive  pretraining  time  and  an  even  lower  investment  in  instructional 
development.  From  the  standpoint  of  efficiency  the  instructional  treat- 
ment administered  to  the  control  group  is  definitely  superior  to  all 
other  instructional  treatments  administered  in  this  experiment.  An 
instructional  procedure  which  merely  supplies  the  learner  with  an  objec- 
tive or  with  a precise  idea  of  the  desired  goal  performance  and  enlists 
the  ingenuity  of  the  learner  in  finding  ways  to  attain  this  goal  perfor- 
mance thus  appears  to  be  a more  economical  way  to  raise  the  instructional 
efficiency  of  pilot  training  than  supplying  the  learner  with  explicit 
"how-to"  cues  which  are  very  costly  to  develop. 

The  question,  "Which  one  of  these  instructional  procedures  should 
be  employed?",  is,  however,  not  only  an  economic  question.  It  touches 
broader  curricular  goals  as  well.  If  the  learner  is  supplied  with  an 
explicit  set  of  instructional  cues  for  each  flight  maneuver,  he  is 
essentially  faced  with  the  task  of  learning  sets  of  procedures,  i.e., 
lists  of  carefully  sequenced  sentences  or  sentence  fragments.  This  may 
very  easily  lead  to  rote  learning  and  mindless  regurgitation.  Even  if 
that  danger  can  be  avoided,  which  is  doubtful,  this  kind  of  instructional 
procedure  is  hardly  conducive  to  the  development  of  judgment,  the 


ability  to  analyze  flying  tasks  and  the  ability  to  make  autonomous 
decisions.  It  therefore  appears  that  an  instructional  treatment  which 
offers  the  possibility  of  attaining  a high  level  of  perceptual  motor 
performance  on  the  one  hand  and  a high  level  of  generic  cognitive  skills 
on  the  other  hand  would  be  most  advantageous. 

The  findings  of  the  study  are  limited  in  their  generalizability 
to  other  maneuvers  and  to  other  teams  of  subject  matter  experts  plus 
instructional  designers.  Another  limitation  to  generalizability  arises 
from  the  fact  that  the  present  as  well  as  the  preceding  experiment 
involved  only  "one-shot"  treatments.  Future  research  should  therefore 
extend  the  instructional  design  procedures  to  other  maneuvers,  use 
different  development  teams  and  examine  the  effects  of  various  types  of 
cognitive  pretraining  over  repeated  experimental  sessions  and  longer 
time  periods. 
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Summary  Table:  Means  of  Subject  Characteristics  by  Groups 


Characteristics 


Group 

n 

Age 

Hours  of 
prior  training 

Hours 
in  T-37 

Hours  in 
Simulator 

A 

8 

23.87 

74.94 

10.46 

3.37 

B 

8 

23.37 

103.37 

10.37 

2.56 

C 

8 

22.62 

20.56 

10.32 

2.00 

D 

8 

23.25 

40.81 

8.55 

2.37 

E 

7 

23.43 

88.43 

12.37 

2.43 

1-  > ’u 
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Raw  Data  for  the  Subject  Characteristic 
Hours  of  Prior  Training 


Subject  i ? 

Groups 

A 

B 

C 

D 

<.  E 

1 

127.0 

250.0 

0.0 

48.0 

100.0 

2 

38.0 

100.0 

0.0 

36.0 

150.0 

3 

36.0 

37.0 

36.0 

36.5 

36.0 

4 

87.0 

55.0 

36.5 

36.0 

170.0 

5 

180.0 

120.0 

30.0 

40.0 

27.0 

6 

36.5 

35.0 

32.0 

35.0 

36.0 

7 

60.0 

60.0 

0.0 

25.0 

100.0 

8 

35.0 

170.0 

30.0 

70.0 

— 
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FOR  YOUR  INFORMATION 


1.  You  are  participating  in  an  experiment  run  by  scientists  from  the 
Department  of  Educational  Technology  at  Arizona  State  University. 

The  project  is  sponsored  under  a grant  from  the  Air  Force  Office 
of  Scientific  Research. 

2.  Your  performance  during  the  experiment  will  not  affect  your  class 
standing  in  any  way.  You  will  remain  an  anonymous  "subject"  in 
all  reports  on  this  experiment.  This  is  not  an  evaluation  situa- 
tion or  testing  situation  for  you. 

3.  One  of  the  experimenters  will  "walk"  you  through  the  whole  se-  . 
quence  of  events.  Here  is  a brief  outline  of  the  procedure: 

a)  First  you  will  go  through  a "Study  Phase."  You  will  be  pro- 
vided with  instructional  materials  for  a certain  flight  maneu- 
ver. Study  the  materials  carefully.  Proceed  at  a rate  which  is 
comfortable  to  you. 

b)  There  will  be  a test  included  at  the  er.d  of  the  instructional 
materials  for  almost  everybody.  Do  your  best  on  it  but  don't 
be  afraid  to  make  a mistake  or  leave  a gap  if  you  don't  know 
the  answer. 

c)  The  Study  Phase  is  followed  by  a "Flying  Phase"  in  the  simu- 
lator. Here  is  the  outline  for  the  "mission": 

-Get  in  and  put  on  the  headset 
-Communications  check  with  experimenter 
-Lower  Canopy 

-Take  controls  and  fly  straight  + level  for  5 min.  (Simu- 
lator will  be  at  15000  ft,  160  Kias  and  take-off  trim  set). 
-Fly  your  assigned  maneuver  six  times. 

Note:  The  experimenter  will  tell  you  when  to  start  a ma- 
neuver by  saying:  START  NOW. 

You  tell  the  experimenter  when  you  finish  the  ma- 
neuver by  saying:  FINISHING  NOW. 

-Between  maneuvers  fly  straight  and  level  at  15000'  and 
160  knots. 

4.  When  you  are  through  with  your  maneuvers,  you  get  out  of  the  train- 
ner  and  fill  out  a brief  questionnaire.  There  will  be  no  de-brief- 
ing. When  you  have  completed  the  questionnaire  you  may  leave  and 
return  to  your  regular  duties. 

5.  When  the  data  are  analyzed  you  will  receive  a briefing  on  what  the 
experiment  was  all  about. 
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STATEMENT  OP  CONSENT 


PROJECT:  Cues,  Feedback:  and  Transfer  In  Undergraduate 
Pilot  Training 


Principal  Investigator:  Dr.  R.C.Haygood 
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In  return  for  the  opportunity  of  participating  as 
a subject  in  a scientific  research  investigation  and  for 
other  consideration,  I hereby  authorize  the  performance 
upon  me  of  the  following  procedure: 

1.  Verbal  textual  instruction  on  a specific 
flight  maneuver 

2.  Performance  of  the  maneuver  in  an  Instrument 
trainer 

3.  Filling  out  a questionnaire  designed  to  elicit 
ray  opinion  on  the  instruction  received 

This  consent  I give  voluntarily  and  after  the  nature 
of  the  experimental  procedure,  the  known  dangers,  and.  the 
possible  risks  and  complications  have  been  fully  explained 
to  me.  I knowingly  assume  the  risks  involved  and  I am  aware 
that  I may  withdraw  my  consent  and  discontinue  participation 
at  any  time  without  penalty  to  myself. 


Name 

Date 

Signature 

-ft  - - 

Witness 

/ 

I L /If  1 L k u 

(o  hAe.71-! 

A C !/  , — L- 

A v v 

Workbench 


i 

■»—  - - 

1 
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Program  Structure 

If  i 

• 

V_  i 

- 

N 


Program 

ABODE 


* 

Type  and  Content 

• 

Instructions 

Expository: 

Purpose  of  learning  the  maneuver 

Expository: 

Maneuver  objective  (with  drawing) 

Practice: 

Name  objective  data  (formal 
prompt) 

Feedback: 

KCR  for  U 

Expository: 

Segmentation  of  the  maneuver 

Expository: 

Segment  1 IC's,  connected  prose 
(with  drawing) 

Expository: 

Segment  1 IC's,  ordered  list 
(w.d.) 

Practice: 

"Order  scrambled  list" 

Practice/Feedback:  "Name  2 IC's" 

Practice/Feedback:  "Name  2 IC's" 

Practice: 

"Name  complete  list  of  4 IC's  in 
order"  (w.d.) 

i 

Feedback: 

KCR  for  7/6 

j 

Segment  2: 

Same  fine-structure  as  7/1  to  7/7 

1 

Practice: 

Segment  1:  Name  list  of  4 IC's 

in  order 

Feedback: 

KCR  for  9/1 

I 

Segment  3 

j 

Practice: 

Segment  1 and  Segment  2:  Name 

in  order 

Feedback: 

KCR  for  11/1 

j 

Segment  4 

j 

Practice:  Segment  2 and  Segment  3:  name  in 

order 

Mark  your  starting  time  here: 


This  programmed  learning  booklet  is  designed  to 
teach  you  as  much  as  possible  about  flying  the  instrument 
maneuver  "Vertical  S-A"  before  you  actually  touch  a stick 
or  throttle.  In  order  to  derive  the  maximum  possible  bene 
fit  from  this  program,  follow  these  ground  rules  to  the 
letter: 


- Read  each  page  carefully 

- . Complete  all  assignments  on  a page  before  you 

go  on 

- Do  not  peek  ahead  for  the  answers  - you  won't 
learn  a thing  if  you  do] 

- Do  the  best  you  can  but  don't  be  afraid  to  make 
mistakes.  Your  performance  on  this  program  will 
not  become  part  of  your  record. 


The  Vertical  S-A  is  a training  maneuver  which  simulates 
flight  conditions  as  they  might  occur  during  Instrument 
approaches.  It  is  designed  to  provide  pilots  with  an 

opportunity  to  Improve  two  things: 

. Speed  and  efficiency  of  crosscheck 

- Aircraft  control 
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16000  ft  target  altitude 


Climb 

1000  ft/min  1000  ft 


— — — — • 

\ 

1000  ft 

i 


Descent 

x..  1000  ft/m  in 


15000  ft  starting  altitude 


Constant  airspeed:  160  KIAS 
Constant  heading  : as  desired 


The  Vertical  S-A  consists  of  a series  of  alternating 
climbs  and  descents.  Prom  straight  and  level  flight  you 
can  start  either  with  a climb  or  a descent.  During  the 
mission  you  are  about  to  fly  you  will  always  start  with  ' 
a climb.  Each  climb  and  descent  covers  1000  ft  of  altitude 
change  - from  15000  ft  to  16000  ft  and  back  down  to  15000  ft. 
Each  climb  and  descent  is  to  be  flown  at  a constant  rate: 

1000  ft/min.  Heading  and  airspeed  (l60  KIAS)  remain  constant 
throughout  the  maneuver. 
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See  whether  you  can  remember  the  figures: 

1.  Airspeed:  KIAS 

2.  Rate  of  climb  or  descent:  ft/min 

3.  Starting  altitude:  ft 

4.  Target  altitude:  ft 

5.  Heading:  Variable  or  constant?  (Circle  one) 


Go  to  the  next  page  and  compare  your  answers. 


' . »*•  ■ ■ 


■'****■ 


1.  Airspeed:  160  KIAS 

2.  Rate  of  climb  or  descent:  1000  ft/min 

3.  Starting  altitude:  15000  ft 
1}.  Target  altitude:  16000  ft 

5.  Heading:  Variable  oj/'constant' 


» 
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3Z“T  1 _ 1 

Straight1^  f ^ Steady  Sta"te* 
and  H Climb 

Level  / 


b 


-'t* 

i 

^ Steady*  "Stale 
I Descent 


Transition 

I 


Transition 

II 


1 


I 

Transition 
III 


The  maneuver  can  be  divided  into  several  segments. 

These  segments  are  of  two  kinds:  steady  states  and  transitions. 
The  maneuver  starts  out  with  a steady  state:  Straight  and  Level 
. flight.  Then  comes  a transition  into  the  climb.  The  climb 
itself  is  again  a steady  state.  After  the  climb  comes  the 
transition  over  the  top  from  the  climb  into  a descent. 

The  descent  itself  is  again  a steady  state.  The  maneuver 
ends  with  another  transition,  the  level-off  to  straight 
and  level  flight  at  starting  altitude. 


1 


J 


Straight  and  Level 
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The  initial  straight  and  level  segment  is  used  strictly 
for  preparation.  Fine  trim  the  aircraft  for  hands-off  flight 
at  160  KIAS  and  keep  this  trim  setting  throughout  the  maneuver. 
Note  the  power  setting  it  takes  to  maintain  160  KIAS  at  the 
assigned  altitude.  At  15000  ft  the  power  setting  should  be 
82li£.  Carefully  adjust  the  attitude  indicator  for  level 
Indication  in  order  to  have  a good  pitch  reference  during 
the  maneuver.  Put  the  heading  at  the  top  of  the  J-2.  Deviations 
are  much  easier  to  spot  this  way. 


1.  Establish  160  and  trim 

2.  Note  power  setting 22- 

3.  Level  attitude  Indicator 
*t.  Heading  on  top  of  J-2 


Remember  these  four  cues  f0r  the  straight 
and  level  segment  in  order  : 
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Examine  the  box  below.  Sort  the  cues  into 
their  proper  sequence  by  writing  the  correct 
number  in  front  of  every  cue. 


Heading  on  top  of  J-2 
Establish  160  and  trim 
Note  power  setting;  $2.-1  % 


Level  attitude  indicator 


The  list  of  cues  below  is  obviously  incomplete 
Write  in  the  two  missing  cues. 


1.  Establish  160  and  trim 

2.  - 

3.  Level  attitude  Indicator 

4.  ' 


. i ~iS.  i 2S  Bl 


See  whether  you  can  now  remember  it  ail.  Write  in 
all  the  cues  for  the  first  segment  in  their  correct  order! 


Transition  I 
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Begin  the  transition  by  applying  power  at  a smooth, 
continuous  and  fairly  rapid  rate.  Watch  the  airspeed 
indicator  and  raise  pitch  so  as  to  maintain  the  airspeed 
at  160  knots.  Continue  to  raise  the  nose  until  the  top  of  the 
center  dot  on  the  attitude  indicator  just  touches  the+5#mark. 


Set  power  to  9 4il/6  to  maintain  160  K1AS  at  this  attitude. 


The  same  again  in  the  form  of  abbreviated  cues: 


Study  the  list  below.  The  cues  are  scrambled. 

Sort  them  into  their  proper  sequence  by  numbering  them 
correctly. 


3.  +5° 

4.  9 4-1# 


1.  Lead  with  power 

2.  Pitch  to  maintain  160 

3.  +5" 

4.  94 ±1# 


Steady  State  Climb 
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Having  accomplished  a smooth  transition, the  task  for 

' 

the  pilot  is  now  to  maintain  a steady  state  climb  at  a 
constant  vertical  rate  and  of  course,  at  a constant  airspeed. 

To  accomplish  this, pitch  must  be  held  as  stable  as  possible 
at  the+  5°  mark.  If  the  vertical  velocity  is  off,  small  adjust- 
ments in  pitch  attitude  will  suffice.  The  width  of  the  black 
lines  on  the  attitude  indicator  is  a good  reference  to  use. 

If  the  airspeed  is  off,  use  small  power  changes  for  corrections. 
During  the  steady  state  climb  is  also  the  best  time  for 
checking  your  heading  repeatedly.  Use  small  amonnts  of  both 
rudder  and  bank  to  correct.  Watch  out  for  the  leadpoint 
to  terminate  the  climb;  10#  of  the  WI  indications*  loo  ft 
prior  to  target  altitude. 


2.  Vertical  velocity  - small  pitch  changes 

3.  Airspeed  - small  power  changes 


4 


1 4 

•) 

f 

f — ' ■ ■'  ■ — - 

1.  Steady  at  + 5° 

2.  Vertical  velocity  - small  pitch  changes 

3.  Airspeed  - small  power  changes 

4.  Heading 

5.  Lead  point 


Transition  II 


At  the  lead  point  start  the  transition  over  the  top 
such  that  the  aircraft  peaks  out  at  precisely  16000  feet. 
During  this  transition  the  vertical  velocity  changes  from 
41000  feet/minute  to  -1000  feet/minute. 

Begin  the  transition  by  leading  with  a smooth  and 
continuous  power  reduction.  Match  this  power  reduction 
by  lowering  your  pitch  smoothly  and  continuously  so  that 
the  altimeter  stops  and  reverses  at  16000  feet.  Continue 
to  lower  pitch  until  the  bottom  of  the  center  dot  touches 
the  -5*  mark. 


c 


Contimie  to  reduce  power  until  shortly  after  the  gear 
warning  horn  comes  on.  Then  check  your  airspeed  and  set 
power  to  58#. 


1.  Reduce  power 

2.  Match  with  pitch  for  16000 

3.  Continue  to  -5® 

4.  Power  past  gear  warning 

5.  Check  for  160  at  5856 


Study  this  list  again  very  carefully.  Don't  Just 
memorize  it  - do  it  mentally.  Refer  back  to  the 
previous  page  if  something  isn't  clear  to  you. 


Check  for  160  at  58$ 

Reduce  power 
Power  past  gear  warning 
Match  with  pitch  for  16000 
Continue  to  -5° 


Unscramble  the  list  by  numbering  correctly 
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1.  Reduce  power 

2.  Match  with  pitch  for  16000 

3.  Continue  to— 5° 

4.  Power  past  gear  warning 
5.. Chech  for  160  at  58$ 


1 
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Steady  State  Descent 


1.  Steady  at  -5° 

2.  Vertical  velocity  - small  pitch  changes 

3.  Airspeed  - small  power  changes 

4.  Heading 

5.  Lead  point 


Transition  III 


This  transition  concludes  the  maneuver.  It  is 
nothing  else  but  a normal  level-off  from  a descent  at  a 
prespecified  altitude. 

Lead  by  adding  power  with  a smooth,  continuous  and 
fairly  rapid  movement.  Raise  pitch  smoothly  and  gently 
so  as  to  arrive  at  level  indication  when  you  reach  15000  feet. 
Hold  level  pitch  and  set  power  to  82tl%, 


32*1# 

Level  pitch  at  15000 
Lead  with  power 
Hold  level 


2.  Level  pitch  at  15000 

3.  Hold  level 

4.  


Let's  see  how  effective  the  program 
was  in  teaching  you  the  points  to 
watch  out  for  when  flying  a 
Vertical  S-A, 

Turn  to  the  next  page  and  take  the 


[ \ test 

i 


Test  Page  1 
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Straight  and  Level 

1.  

2.  

3.  

4.  


Transition  I 

1.  

2.  

3.  

4.  

Steady  State  Climb 

1.  

2.  

3.  

4.  

5.  


Transition  II 

1. 

2. 

3. 
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Systematically  developed  cues 


Straight  and  Level 

1.  Establish  160  and  trim 

2.  Note  power  setting:  82-  1Z 

3.  Level  attitude  indicator 

4.  Heading  on  top  of  J-2 


Transition  1 


1.  Lead  with  power 

2.  Pitch  to  maintain  160 

3.  +5° 

4.  94  il% 


Steady  State  Climb 

1.  Steady  at  +5° 

2.  Vertical  velocity  — small  pitch  changes 

3.  Airspeed  - small  power  changes 

4.  Heading 

5.  Leadpoint 


Transition  2 

1.  Reduce  power 

2.  Match  with  pitch  for  16000 

3.  Continue  to  -5° 

4.  Power  past  gear  warning 

5.  Check  for  160  at  58% 


Steady  State  Descent 

1.  Steady  at  -5° 

2.  Vertical  velocity  - small  pitch  changes 

3.  Airspeed  - small  power  changes 

4.  Heading 

5.  Leadpoint 


Transition  3 

1.  Lead  with  power 

2.  Level  pitch  at  15000 

3.  Hold  level 

4.  82 t 1% 


* 
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Current  operational  cues 


Straight  and  Level 

1.  Hold  160 

2.  Align  J-2  compass 

3.  Check  WI 

4.  Level  attitude  indicator 


Transition  1 

1.  Increase  pitch  and  Power:  l*t  and  94iriZ 

2.  Maintain  160 

3.  WI:  + 1000  ft /min 

4.  Wings  level 


Steady  State  Climb 

1.  When  stable  check  WI 

2.  Fine  tune  for  1000  ft/min 

3.  Power  for  160 

4.  Trim 

5.  Heading 


Transition  2 

1.  30  - 45  sec:  Lead  point 

2.  Lower  nose  2*s  bar  widths 

3.  Reduce  power  to  maintain  160 

4.  WI:  -1000  ft/min 

5.  Wings  level 


Steady  State  Descent 


1. 

2. 

3. 

4. 

5. 


Transition  3 

1. 

2. 

3. 

4. 


Check  tachs 
Maintain  160 
Slow  changes 
Trim 
Heading 


Lead  point 
Level  pitch 
Increase  power 
Wings  level 


v-.t£9 
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Changes  on  the  basis  of  tryout  #1  and  tryout  #2 


1.  Feedback  added  after  each  response. 

2.  Immediate  posttest  added  (as  last  two  pages) . 

3.  Lead  point  marked  and  labelled  in  expository  frames  for  the 
second  and  third  transition  segment. 

4.  Corrected  one  SC,  Straight  and  Level,  if 2 to  82  + 12  (instead 
of  81  + 1%) . 

5.  Changed  93  + 12  to  94  + 12. 

6.  Corrected  typographical  error  on  p.  3 (150 00  feet). 

7.  Added  direction  arrows  in  latter  part  of  program. 

8.  Checked  and  marked  the  degrees  of  pitch. 

9.  Eliminated  "funny"  remark  on  bottom  of  p.  25. 

10.  Repaginated. 

Changes  on  the  basis  of  tryout  #3 

1.  Eliminated  pagination. 

2.  Corrected  typographical  errors. 

3.  Inserted  blue  pages  after  each  student  response. 


Communications  between  Experimented  and  Subject  during  the  simulator  .phase 
1.  Preparation: 

a.  After  both  Experimentor  and  Subject  have  put  on  headsets  a 
standard  USAF  communications  check  is  accomplished. 

b.  Experimentor:  "Adjust  your  rudder  pedals.” 

(Subject  adjusts  pedals). 

Experimentor:  "The  simulator  is  now  in  the  FREEZE  condition. 

I will  now  unfreeze  the  simulator  and  you  take  control.” 
(Experimentor  unfreezes  simulator). 

Experimentor:  "You  have  it."  (Experimentor  closes  canopy). 

"Establish  straight  and  level  flight  at  15000’ , 160  knots  and 
3600  of  heading.  This  simulator  is  very  sensitive.  You  need 
to  use  a very  light  touch.  Three  fingers  will  do  it.  When 
you  have  established  straight  and  level  flight  you  will  fly 
the  Vertical  S-A  six  times.  In  between  each  Vertical  S-A 
you  will  fly  straight  and  level  for  one  minute.  I.  will  tell 
you  when  to  start  a Vertical  S-A,  you  will  tell  me  when  you 
are  finished  with  the  maneuver,  that  is  when  you  come  back 
down  to  15000  feet.  Any  questions?"  (Experimentor  then 
answers  questions  if  they  pertain  to  procedure.  Other 
questions  are  ignored.) 

2.  Recording  phase: 

Experimentor:  "Start  five  minutes  straight  and  level  now." 

Experimentor:  "Three  minutes  are  up,  two  more  to  go." 
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Experlmencor:  "Start  your  first  Vertical  S-A  now." 

Subject:  "Finished  now." 

Experlmentor:  "O.K. , fly  straight  and  level  for  one  minute." 

Experlmencor:  "Start  your  second  Vertical  S-A  now." 

etc.  to  trial  #6. 


Subject  Master  Sheet 


1? 
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Name: 


< ~r. 


Age: 


26 


Group : 


Running  #: 


? 


Prior  Experience:  O 

fJof  fir*-**.  Xs&Cf  'OCd-Gi 

Cfr. £X 


Date: 


5/7 


T-37  hours: 


f.c 


Time  in: 


Of'Qf 


Solo: 


ATo 


Time  out: 


to  rr 


T-4  hours: 


/ f o 


Time  elapsed: 


Last  trainer  mission: 


2/o  / 


PRETRAINING 


In  Program  Errors 

Start 

Of  ;QS 

Time  through  program 

■2$ 

Finish 

Of.  5 2. 

Posttest  Errors 

Elapsed  time: 

■ 

Time  through  posttest 

^ 

• 

■ 

Percent  correct 

Error  Rate 

SIMULATOR 

Total  elapsed  time  Z 5”* 

■ 

Elapsed  times  for  trials 
10.  b? 

1 

2:  /g 

4 

'Z  ^7 

■ 

2 

/ - 

5 

Z : °7 

1 

3 

z .‘or 

6 

Zr  + 

■ 

Protocol  remarks 


ftmi.-*  <A  ■ '•  . 
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PROTOCOL  SHEET 


Name  IreR./^ 

Group 

<£" 

Number 

9 

Date 

7/7 

Time  in  Of  Of 

Time  out  //? . 

zr 

STUDY  PHASE  **  ***>&  / 0?^Z  **■# 

£)<L,fa€o£  fo-  '*'*■***■£'  fijfA*  o ■$<*"*Cu!&f0  *<*uu.i 

fZ  -«^CC A*K 
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SIMULATOR  PHASE  &?*?/  3 931  / 

f *2  / I ZleM+i'f  Mr^  f++  i-&OM4.€jC 
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5 ft  00  ^ e^*-f  7*  • *'-'  •-<-<? 
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6.  Which  part  or  aspect  of  the  maneuver  was  the  hardest? 


7.  Did  you  use  trim  during  the  constant  rate  climb  or  descent? 


8.  What  is  the  best  pitch  reference  you  can  use  during  the  maneuver 1 


9.  If  you  had  your  choice,  which  instructional  procedure  would  you 
prefer  in  order  to  prepare  for  flying? 

(Number  in  order  or  preference) 

Selfs tudy  only 

Selfstudy  plus  briefing  by  IP 
Briefing  by  IP  only 
Programmed  Instruction 

Programmed  Instruction  plus  briefing  by  IP 

10.  How  would  you  rate  the  instruction  you  received  during  the  study 
phase? 

(Circle  the  number  which  corresponds  most  closely  to  your 
impressions) 


Usefulness  in  terms  of 
helping  you  to  perform 
the  maneuver 

Thoroughness 

Completeness 

How  useful  were  the  drawings? 


High 


Indicate  how  well  you 
liked  the  materials 


11.  Which  is  harder  to  fly 


the  simulator  used  in  the  experiment 
the  regular  simulator 
the  aircraft? 

(check  one) 


**  ' 


I 


12.  Any  particular  comments  about  the  simulator? 


13.  Any  comments  about  the  study  environment? 


14.  Any  other  comments,  remarks,  suggestions? 


We  thoroughly  appreciate  your  cooperation  in  this  research 
effort.  There  is  one  more  very  Important  thing  we  would 
like  to  ask  of  you: 

DO  NOT  TALK  TO  YOUR  CLASSMATES  ABOUT  THE  TRUE  NATURE  OF 
THE  EXPERIMENT  FOR  THE  NEXT  THREE  WEEKS ! 


Prior  information  may  produce  extreme  distortions  of  the 
results.  If  you  are  asked,  please  answer  by  saying  that 
a research  team  from  ASU  is  experimenting  with  some 
new  performance  measurement  techniques.  The  participants 
are  merely  asked  to  fly  a profile  given  over  RT  (this  is 
quite  close  to  the  truth!). 


•x 


^ i 


t • t. 
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Scoring 


for  groups  1 and  2:  Current  Operational  Cues 


Straight  and  Level 


Hold  160 

Align  J-2  compass 
Check  WI 

Level  attitude  indicator 


Transition  I 


1.  Increase  pitch  and  Power: 

2.  Maintain  160 

3.  WI:  + 1000  ft /min 

4.  Wings  level 

Steady  State  Climb 


1 1/4  and  94 ±1£ 


When  stable  check  WI 

Fine  tune  for  1000  ft/min 

Power  for  160 

Trim 

Heading 


Transition  II 


1.  30  - 45  sec:  Lead  point 

2.  Lower  nose  2 1/2  bar  widths 

3.  Reduce  power  to  maintain  160 

4.  WI:  -1000  ft/min 

5.  Wings  level 

Steady  State  Descent 

1.  Check  tachs 

2.  Maintain  160 

3.  Slow  changes 

4.  Trim 

5.  Heading 


Transition  III 


1.  Lead  point 

2.  Level  pitch 

3.  Increase  power 

4.  Wings  level 


— jfcj-aaA.  k.  \*  . * 
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Scoring  Key  for. 


and  4:  Systematically  developed  cue^ 


Straight  and  Level 

1.  Establish  160  and  trim  + 

2.  Note  power  setting:  82_  1* 

3.  Level  attitude  Indicator 

4.  Heading  on  top,  of  J^2 

Transition  I 

1.  Lead  with  power 

2.  Pitch  to  maintain  160 

3.  +5° 

4.  94?  1% 

Steady  State  Climb 


1. 

2. 

3. 

4. 

5. 


Ver tfcai** ve loc ity  - small  pitch  changes 
Airspeed  - small  power  changes. 

Heading 
Lead  point 


Transition  II 

1.  Reduce  power 

2.  Match 'with  pitch  for  16000 

3.  Continue  to  -5° 

4.  Power  past  gear  warning 

5.  . Check  for  160  at  58% 

Steady  State  Descent 


1. 

2. 

3. 

4. 

5. 


KSaf  velocity  - small  pitch  changes. 
Airspeed'  - small  power  changes 
Heading 
Lead  point 


Transition  III 


1.  Lead  with  power 

2.  Level  pitch  at  15000 

3.  Hold  level 

4.  82  * 1% 


ni  i i iiMlim  ' . 
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